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ABSTRACT 



This thesis examines the "Problem Solving Skills for 
Managers" training package, piloted by the Coast Guard 
Leadership and Management School in April 1983. Four ques- 
tionnaire instruments developed by the company which pro- 
duced the training package were analyzed to determine the 
effectiveness of the training program. A quasi-experimen- 
tal pre-test /post-test /control group research design was used 
by the Coast Guard project manager and this thesis used a 
regression procedure to counteract any regression effect. 

The results of the analysis suggest that the training program 
was not effective as given and suggests further study to 
determine why it was not effective. 
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INTRODUCTION 



I . 



"The dollar spent on training today is a marginal 
dollar. Today, more than ever, training professionals 
must demonstrate the effectiveness of their programs.... 
Spending money on unnecessary training, inappropriate 
training, or training that doesn't train can spell 
disaster for those who design such programs." [Ref. 1] 

A . BACKGROUND 

These introductory remarks were written by a learning 
technology manager in industry, but they apply equally well 
to the government sector in general and to the Coast Guard 
in particular. Training plays a vital role in preparing 
Coast Guard personnel for the increasingly complex skills 
required to meet the challenges of technological growth. 
Training is required to insure that the Coast Guard can 
take advantage of modern technology by using all of its 
resources as effectively and efficiently as possible. These 
include financial, physical and human resources. It has 
been said that people are the Coast Guard's most important 
asset. ^ Leadership has traditionally been important in the 
military services to insure the "good order and discipline" 
of these assets. The effective management of these human 
resources becomes even more important as increasing amounts 

^For example, see former Coast Guard Commandant Admiral 
John B. Hayes' State of the Coast Guard address of 16 
January 1979. 
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of time and money are invested in their training and develop- 
ment. This is one of the reasons that leadership and manage- 
ment training is provided to those in supervisory positions. 

The Coast Guard recognizes the need to efficiently use 
these training dollars and has prescribed the responsibili- 
ties and techniques for training management [Ref. 2]. One 
of the techniques is the use of Instructional Systems 
Development (ISD), a method of identifying training needs, 
determining the optimal training methods, developing an 
appropriate training design, implementing and evaluating 
the training. A diagram of the basic ISD process is provided 
by Figure 1.1. 

This thesis will examine the "Problem Solving Skills for 
Managers" training package, developed by Interact Performance 
Systems, Incorporated , in 1982, and piloted by the CoaSt 
Guard Leadership School during the period 5 April 1983 through 
2 August 1983. The main objective of the training is for 
supervisors to increase their effectiveness in dealing with 
interpersonal problems in their work settings by using the 
steps in the problem solving process that are described in 
the training. In this particular training program, parti- 
cipants learn to communicate the situation in a specific 
and non-threatening manner; to diagnose the situation as an 
ability or a motivation problem; to communicate the conse- 
quences — natural (e.g. the job will not get done), to others, 
to the supervisor, or imposed — until compliance is gained; 
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to determine who does what /when and set a follow-up date; 
how to find long-term solutions; and how to deal with emer- 
gent problems. The process involves extensive use of video- 
taped modules showing both ineffective and effective 
behaviors, structured role-playing and group discussions. 

The training is given in a series of four one-day segments, 
one segment per week. After each training segment, partici- 
pants "contract" to practice their skills during the week 
and to report their results when the class next meets. 

B. PURPOSE 

The purpose of this thesis is to accomplish a portion of 
the evaluation phase required by ISD [Ref. 2], and in 
particular the internal evaluation of the "Problem Solving 
Skills for Managers" training package piloted by the Coast 
Guard Leadership School during the period 5 April 1983 
through 2 August 1983. (The other phases of the ISD process 
in relation to this training package will not be discussed 
in this thesis and are assumed to have been completed prior 
to this stage.) Internal evaluation refers to an analytical 
means of measuring the instruction process by determining 
student reaction or degree of behavioral change attributed 
to the actual training- [ Ref . 2]. The instruments used to 
measure the instruction process consist of a series of ques- 
tionnaires designed by the developer of the training process. 
The training was conducted by a staff member of the Coast 
Guard Leadership and Management School. The data was 
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collected and a computerized data base established by the 
leadership school staff. The purpose of this thesis is 
to analyze the data and make a determination of the effec- 
tiveness of the training package. 
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I I . METHODOLOGY 



A. RESEARCH SETTING AND DESIGN 

The "Problem Solving Skills for Managers" training 
package was presented to supervisors at four Coast Guard 
stations in the Twelfth District (San Francisco area) as a 
pilot program with the goal of determining if the training 
should be pursued on a larger scale within the Coast Guard. 
Two stations were trained initially while the remaining two 
stations were used as a "control group." These "control 
group" stations subsequently received the same training. 

For clarity and consistency throughout this thesis, the 
first group to receive the training will be referred to as 
the "Early Treatment Group" and the second group to receive 
the training as the "Late Treatment Group" (see Figure 2.1) 
The first portion of the training design used by the 
Coast Guard Leadership and Management School Project 
Manager /Trainer is referred to as a quasi-exper imental , 
non-equivalent control group design [Ref. 3]. It involves 
an experimental group and a control group ("early" and 
"late" treatment groups, respectively), both given pre- and 
post-measures. The early group and late group do not have 
pre-experimental sampling equivalence. These groups const! 
tute the "naturally assembled collectives" of four Coast 
Guard stations, matched as closely as possible for size 
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(total numbers of people assigned, supervisors and subordi- 
nates combined) and organizational profile (operational 
mission, common group commander, rank of those in leadership 
positions within the organizational structure). That is, 
the participants are not randomly selected or assigned to 
these groups as a "true" experimental design would require. 
The assignment of the treatment to one group or another is 
assumed to be random and under the researcher's control. 

The training was conducted at each station by the same 
experienced instructor from the Coast Guard Leadership and 
Management School in Petaluma, California. The data 
collected with the measurement instruments was transcribed 
by the Management School staff to form a raw computerized 
data base. This researcher organized the data base into 
four files, one for each type of questionnaire, for subse- 
quent analysis. 

B. INSTRUMENTATION 

The same pre-measures and post-measures were given to 
each of the control and experimental groups, and consisted 
of a set of four questionnaires that were administered at 
the points in the training design as shown in Figure 2.1. 
These questionnaires were designed by the company that 
developed and produced the training package. 
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1 . 



Subordinate Organization Survey (SUBQ) 



This questionnaire consists of three parts: demo- 

graphics; subordinates' perception of organizational 
climate, satisfaction and commitment; and subordinates' 
perception of their supervisors' behavior in dealing with 
problems. It was completed by the subordinates of the 
supervisors who received or were scheduled to receive the 
training at each of the stations. The demographic informa- 
tion section was completed only at the first administration 
of this questionnaire. 

2 . Supervisory Organization Survey (SUPQ) 

This questionnaire also consists of three parts: 
demographics; supervisors' perception of organizational 
climate, satisfaction, and commitment; and knowledge of 
problem solving/organizational support. Thfe supervisors who 
received or were scheduled to receive the training completed 
all portions of this questionnaire at each administration, 
except for the demographics section, which was completed 
only for the first administration. 

3 . Multiple Choice Questionnaire (MCQ) 

This questionnaire was completed at each administra- 
tion by each of the supervisors who received or were sched- 
uled to receive the training. It was designed to measure 
understanding of problem solving skills (categorical and 
episodic ) . 
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4. 



Supervisory Evaluation of Training (SETQ) 



This questionnaire was completed by supervisors on 
the administration following completion of the training. 

It was designed to measure the supervisors’ reaction to the 
training program and their motivation as determined by 
intrinsic factors (e.g. recognize the positive natural 
consequences of using the problem solving skills) and 
extrinsic factors (e.g. organization support). 

Copies of all four of these instruments are included 
as Appendix A. Each of these questionnaires uses codes to 
identify the subordinates and supervisors within the data 
base for cross-referencing or comparing results based on 
subordinate or supervisor responses on each variable, while 
maintaining the anonymity of the participants. The coding 
of the questionnaires is explained in the introduction to 
the appendix. 

C . SAMPLE 

The data collected from these four measurement instru- 
ments was based on a combined sample (N = 111) of subordi- 
nates and a combined sample (N = 38) of supervisors who 
received the training at the four stations. (The subordi- 
nate sample size refers to the number of questionnaires 
filled out at each administration by subordinates; there 
were actually a total of 52 subordinates, some of whom 
completed questionnaires for more than one supervisor.) A 
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portion of the supervisors who received the training and 
completed the Supervisory Organization Surveys were also 
considered to be subordinates and filled out the Subordinate 
Organization Surveys as well. These dual-role cases were 
not identified in the data base and could not be distin- 
guished. This could be a source of contamination of the 
results noted in this study and will be discussed further in 
chapter four. Table I shows the breakdown of supervisors 
and subordinates for each unit. 



Table I 

Sample Sizes by Unit and Category 





Category 


Unit 


Subordinates 


Supervisors 


E300 


035 . 


Oil 


E500 


021 


007 


C400 


028 


Oil 


C600 


027 


009 


Total 


111 


038 


Note : 


E identifies the Early Treatment Group and 



C identifies the Late Treatment Group. 



Although the stations selected by the Coast Guard Project 
Manager /Trainer were matched in pairs as closely as possible 
for size and organization profile, this thesis will not 
analyze the data obtained in terms of "matched" pairs of 
units. If matching was to be used as an attempt to 
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compensate for the differences between non-equivalent control 
groups when random assignment to experimental and control 
conditions is not possible, it may not only fail to provide 
the desired equivalence, but in certain circumstances may 
actually assure the presence of unwanted regression effects 
[Ref. 3]. The data samples will therefore be aggregated and 
compared as early treatment vs. late treatment groups. 

D . PROCEDURE 

A number of hypotheses regarding change as a result of 
the training will be examined to determine the effectiveness 
of this training program. Effectiveness can be evaluated in 
terms of reaction, learning, behavioral and/or results 
criteria [Ref. 4]. Each is used to examine different 
aspects of the program. Reaction criteria measure how well 
the participants- liked the program. People are more likely 
to obtain maximum benefit from a program they enjoy. 

Reaction, then, provides one means of identifying reasons 
for the success or failure of a training program. Learning 
refers to the knowledge and skills absorbed by the partici- 
pants. Behavior is the transfer of the knowledge and skill 
to actual performance on the job. Results criteria can be 
cost-related (lower cost, increased efficiency) or behavioral 
(reduced absenteeism, attrition, disciplinary involvements) 
measures, which give evidence of the training's impact on 
organizational effectiveness. Because of many complicating 
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factors, however, it is very difficult to evaluate in terms 
of results [Ref. 4]. 

1 . Approach 

This thesis will examine the effectiveness of the 
training program primarily in terms of learning and 
behavior . 

a. Learning 

Learning will be analyzed in terms of the 
results of the Multiple-Choice Questionnaire (MCQ). Although 
the Supervisory Organization Survey (third part) also seems 
to measure participant knowledge, it appears to be somewhat 
redundant to the MCQ and will not be examined in this 
analysis. The data base was recoded so that the desired 
answer received a value of one and all other answers a 
value of zero. A score for each participant was then 
computed as a percentage correct of the questions answered. 

b. Behavior 

Behavior will be analyzed in terms of the 
results of the Subordinate Organization Survey (SUBQ), Part 
III. To determine if any of the fifty variables (questions) 
could be combined and scaled in order to reduce the number 
of data comparisons required, the data from the first admin- 
istration of SUBQ Part III was subjected to factor analysis 
using principal factoring with iteration and varimax 
(orthogonal) rotation. Nine factors were identified. Using 
the Scree Test [Ref. 5: pp . 152-156], a plot of Eigenvalue 
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vs. factor number (see Figure 2.2), it was determined that 
two factors were the primary contributors. The first two 
factors accounted for most ( 77 . 3 %) of the variance in that 
data set. Therefore, a second factor analysis was made 
with only two factors extracted. The factor loadings from 
the varimax rotated factor matrix were used to assign each 
variable to one of the two factors based on the weight of 
the factor for that variable. In reviewing the questions 
that loaded on each factor, it appears that the first factor 
relates to "problem solving support" (where a high rating 
indicates more support) and that the second factor relates 
to "passing the buck" with regard to problem solving (where a 
low rating indicates less "passing the buck"). Table II 
provides a listing of the variables assigned to the first 
factor, the corresponding questionnaire question and the 
appropriate factor loading, in descending order of factor 
loading. Table III provides the same information for the 
second factor. 

The values of the variables included in each 
factor were then combined into an average value for each 
subordinate, so that only two variables would have to be 
examined to describe behavior. A listing of the means and 
standard deviations of each variable and the correlation 
matrix for the input variables are included in Appendix B. 
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Figure 




2.2 Scree Test for SUBQ Part III Administration 1 
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Table II 



SUBQ Part III Factor One--Problem Solving Support 



Variable 

SUBQ1090 

SUBQ117A 

SUBQ109J 

SUBQ109K 

SUBQ114B 

I 

SUBQ109N 

SUBQ109A 

SUBQ117B 

SUBQ118C 

SUBQllOB 



Factor 

Quest ion Loading 

Does your supervisor take action in a .81498 
timely way to solve complaints you 
bring to his or her attention? 

Does your supervisor try to find ways .78898 
to make the job easier in the future? 

Is your supervisor supportive in .78832 

solving work related problems you want 
help with? 



Does your supervisor bring resources .78726 

to bear to help you solve problems 
on the job? 

To what extent does your supervisor .77771 

explain how correcting a problem 
affects the job? 

Is your supervisor quick to follow .76761 

through on problems you bring to his 
or her attention? 



Does your supervisor keep up-to-date .76639 

with the problems you are experiencing 
on the job? 

Is your supervisor concerned about .76197 

making the job less difficult the 
next time you have to do it? 

Can you be sure that your supervisor .75299 

will really follow up to ^ee that the 
problem is solved? 

To what extent is your supervisor clear .74615 
about the facts of problems? 
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. 7i586 



SUBQ114A 

SUBQ109C 

SUBQ109B 

SUBQ118D 

SUBQ112C 

SUBQ109D 

SUBQ116B 

SUBQ1I6A 

SUBQ112B 

SUBQ112D 

SUBQ119D 

SUBQ119C 



When discussing a problem, to what 
extent does your supervisor clearly 
explain what would go wrong wirh the 
job if the problem weren't corrected? 

Does your supervisor take time to ask 
you whether there are ways he or she 
can help make your job easier? 

Does your supervisor take time dis- 
cussing your point of view on your 
work? 

Are you able to trust that your 
supervisor will do what the two of 
you have agreed needs to be done? 

Accurately summarize your feelings 
on the matter? 

Does your supervisor come to your 
work area to ask you whether you 
need any help to make your job easier? 

To what extent does your supervisor 
show respect for your ideas and 
abilities on the job? 

To what extent does your supervisor 
treat you in a way that shows he or 
she values your experience and opinions 
on the job? 

Demonstrate by restating that he or she 
fully understands the point you are 
tring to make? 

Carefully listen without arguing or 
becoming upset? 

When dealing with an upset subordinate, 
to what extent does your supervisor ask 
the per-son what is bothering him or her? 

When dealing with an upset subordinate, 
to what extent does your supervisor ask 
what has made the person upset or angry? 



.74553 

.73757 

.73488 

.72400 

.69524 

.68101 

.68007 

.64727 

.64726 

.64267 

.63689 
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.61350 



SUBQ120B When you have done a good job, to 
what extent does your supervisor 
express his or her appreciation 
for what you have done? 

SUBQllOA When your supervisor brings up a 

problem, to what extent is he or she 
clear about exactly what is bothering 
him or her? 



SUBQ112A Listen to your point of view without 
interrupting or cutting you off? 



Table III 

SUBQ Part III Factor Two — Passing the Buck 



Variable 

SUBQ113B 

SUBQ113C 

SUBQlllB 

SUBQlllA 

SUBQ115B 

SUBQ109G 



Quest ion 



To what extent does your supervisor 
"shoot from the hip" when solving 
problems instead of stopping to learn 
about the problem first? 

To what extent does your supervisor 
blame you for problems that aren't 
your fault? 

To what extent does your supervisor 
draw conclusions about you as a person 
when discussing problems? 

To what extent does your supervisor 
put you down when describing problems? 

When answering questions about why 
something must be done a certain way, 
to what extent does your supervisor 
threaten you with what might happen if 
you don't do what he or she wants? 

Does your supervisor give you excuses 
for not solving that show you he or she 
won't "go to bat" for you? 



. 57595 
.54005 

Factor 

Loading 

.73719 

.73368 

.72942 

.72151 

.69534 

.68467 
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SUBQ109M 

SUBQ113A 

SUBQ113D 

SUBQ121A 

SUBQ121B 

SUBQ119A 

SUBQ115C 

SUBQ109P 

SUBQ118B 

SUBQ120A 

SUBQ119B 



Does your supervisor promise to see what 
can be done about a problem but then 
never let you know what he or she did to 
solve it? 

To what extent does your supervisor 
impose a solution to a problem without 
first stopping to figure out what is 
going on? 

When discussing a problem with you, to 
what extent does your supervisor assume 
you're the cause of the problem when 
you're not? 

Does your supervisor act in ways 
that make it hard to trust him or 
her? 

Does your supervisor tell you whatever 
he or she thinks you want to hear in 
order to get you to do what he or she 
wants? 

When dealing with an upset subordinate, 
to what extent does your supervisor 
get angry at him or herself? 

When answering questions about why 
something must be done a certain way, 
to what extent does your supervisor use 
his or her "stripes” as your supervisor 
to get you to do what he or she wants? 

Does your supervisor get on your case 
too much about little things that are 
not worth the time they'd take to fix? 

Is it left unclear as to who will do 
what to solve the problem? 

When you have done well on the job, 
to what extent does your supervisor 
express his or her appreciation for 
what you have done? 

When dealing with an upset subordinate, 
to what extent does your supervisor get 
into an argument? 



.66854 

. 66449 

. 66365 

.65113 

.63465 

.62128 

.61915 

.59848 

.59216 

.56787 

.56011 



29 



1 




SUBQ115A 


When answering questions about why 
something must be done a certain way , 
to what extent does your supervisor 
order you to do it the way he or 
she wants? 


.55227 


SUBQ118A 


Does your supervisor leave you guessing 
about what should happen next? 


.55187 


SUBQ109L 


Does your supervisor say he or she will 
take action on a problem but then never 
get back to you to solve it? 


.55185 


SUBQ109I 


Does your supervisor refuse to take 
on the people in power in order to 
remove complaints in your department? 


.53738 


SUBQ109F 


Does your supervisor fail to deal with 
problems before they become severe? 


.52699 


SUBQ109H 


Is your supervisor unwilling to argue 
or fight for you to solve problems 
you bring up? 


.45610 


SUBQ109E 

c . 


Does a problem have to get out of hand .45293 

before your supervisor chooses to deal 
with it? 

Results 

One method of examining the impact on organiza- 



tional effectiveness is to measure the subjects views on 
organizational climate, satisfaction and commitment and see 
if they change after training. The Subordinate Organization 
Survey Part II and the Supervisory Organization Survey Part 
II ask questions in these categories (see Appendix A) which 
are similar to some of the questions in the related sections 



2 

"Subjects” as used here refers to both supervisors and 
subordinates who were measured on these factors. 
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of the Michigan Survey of Organizations [Ref- 6]. Again, in 
an effort to determine the possibility of simplifying the 
data base, the variables in SUBQ Part II Administration 1 
were subject to factor analysis using principal factoring 
with iteration and varimax (orthogonal) rotation. The 
results indicated that the questions relating to organiza- 
tional climate could be considered as a single factor. For 
satisfaction, SUBQ107E (satisfaction with pay) was not 
related to the other variables, so it was not included in 
the scale for satisfaction (the other items accounted for 
78.7 percent of the variance). For commitment, the results 
indicated that the three questions could be considered one 
factor. Although the scree test was inconclusive, Guttman's 
procedure [Ref. 5: p. 147] for estimating the lower bound 

for the number of factors suggests using the factors with 

♦ 

eigenvalues greater than or equal to 1.0, leading to the 
selection of one factor for commitment. The scree test 
plots are shown in Figure 2.3, Figure 2.4 and Figure 2.5. 

A listing of the eigenvalues, means and standard deviations 
of each variable and the correlation matrix for the input 
variables are included in Appendix C. These factors were 
applied for each administration of both SUBQ Part II and 
SUPQ Part II. The values of the variables included in each 
factor were then combined into an average value for each 
respondent so that only three variables would have to be 
examined to describe "Results." 
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Figure 2.3 Scree Test for Organizational Climate 
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Figure 2.4 Scree Test for Satisfaction 
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Figure 2.5 Scree Test for Commitment 
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Hypotheses to be Tested 



Figure 2.6 shows the relationships to be examined. 

In each case, the null hypothesis (Ho) is that there is "no 
change." Each hypothesis will be described in detail below. 




Figure 2.6 Hypotheses to be Tested 



a. Hypothesis A 

This analysis tests for the effect of training 
on the "early treatment group," the first set of stations to 
receive the training (see Figure 2.7). 



E 1 


0 


1 X 1 


© 


f— 


© ' 


0 


L 1 


0 


1 1 


0 




X 0 1 


© 



Figure 2.7 Hypothesis A 

Since the early and late treatment groups are non-equivalnet , 
not randomly assigned, the difference in ratings on the 
various measures could be due to a regression effect. A 
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comparison of simple difference scores may therefore be 
misleading. What is needed is to compare the results 
actually attained with the results that would have been 
attained under the appropriate null hypothesis of no treat- 
ment effect [Ref. 7: p. 25]. To account for this, a method 
of estimating the no-treatment result for the experimental 
(early treatment) group will be used. The results of 
the late treatment group's second administration of the 
questionnaire of interest will be regressed on the results 
of the late treatment group's first administration, producing 
a constant and an unstandardized regression coefficient. 

These values will be applied to the actual results of the 
first administration for both the early and late treatment 
groups to obtain a predicted value for the second administra- 
tion. These predicted values will then be subtracted from 
the actual values to obtain the difference or residual 
values. These residual values will then be compared between 
the late and early treatment groups by means of a t-test. 

Hypothesis A can be broken down into analyses 
between the late and early treatment groups for SUBQ Part III 
Factor One, SUBQ Part III Factor Two, SUBQ Part II Factor 
One, SUBQ Part II Factor Two, SUBQ Part II Factor Three, 

SUPQ Part II Factor One, SUPQ Part II Factor Two, and SUPQ 
Part II Factor Three. These comparisons and the statistical 
techniques used are summarized in Table IV. 
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TABLE IV 






Sub-Hypotheses for H(A) 




>T ^ 

a U J. — 

Hypothesis: 


No chases be s •» = = s 
"early" 'and 
"lare'^ groups for: 


hethcc of 
Analysis 


H (A1) 


Subordinate perception 
of SuDerviscr 'Prcblen 
Solving Support'. 


STEP 1: 
Hearession of 
"late" group 
adain 2 on 
.admin 1 ; 


H (A2) 


Subordinate Perception 
of Supervisor "Passing 
the Buck". 


STEP 2: 

Prediction of 
values of admin 
2 from values of 
admin 1 for both 
"late" and 
** 9 2. r*]. y ** 
groups; 


H (A3) 


Mult iole-ch oics 
Questionnai re 
Score 


H (A4) 


Subordinate Perception 
of Oraanizaticn 
cl i .11 a te . 


H (A5) 


Subordinate 
Sati s faction 


Computation of 
Res idua Is ; 


H (A6) 
H (A7) 


Subo r din at e 
Commitnent 

Supervisory Perceotion 
of Organization 
dim ate. 


STEP 3: 

t-test between 
"early" grcup_ 

"late" group 
residuals. 



K (AS) 


Supervisor 
Sati sfactio n 


H (A9) 


Supervisor 
Commitme nt 
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b. Hypothesis B 

This analysis tests for the effect of training 
on the "late treatment group," the second set of stations to 
receive the training (see Figure 2.8). 

= O " © © o 

^ © O 

Figure 2.8 Hypothesis B 

In this situation, the regression effect is assumed to have 
taken place between the first and second administration 
[Ref. 8]. Hypothesis B can be broken down into analyses of 
the same variables as Hypothesis A, but comparing between 
administration 2 and administration 3 for the "late treat- 
ment group." These comparisons are summarized in Table V. 

c. Hypothesis C 

This analysis tests for the longitudinal effect 
of training for the "early treatment groups," between the 
first two administrations after training (administration 2 
and administration 3), as shown in Figure 2.9. 
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TABLE V 

Sub-Hypotheses for H(B) 



t 

I 



:ju11 

H yporhes as: 


Nc chanqf e between 
administrations 2 
and 3 of "laze" 
group for: 


H (B1) 


Subordinate perception 
of Supervisor 'Problem 
Solving Support'. 


H (B2) 


Subordinate Percepzion 
of Supervisor "Passing 
the Buck". 


H (B3) 


Multi ple-cho ice 
Qusszrcnnair e 
score 


H (B4) 


Subor dinars Perception 
of Organization 
climate. 


H (B5) 


S ubor dinare 
Satis facrion 


H (B6) 


Subordinate 
Commi tment 


H (B7) 


Supervisory Perception 
0 f‘ Or ganizat ion 
clima te. 


H (B8) 


S uDer visor 
S at is fact ion 


H (B9) 


S uper visor 
Commi tmenr 



Msthod of 
Analysis 



T- Test : 
Comoar iscn 
of actual 
ratings ' 
means 
between 
Admin. 2 and 
Admin. 3 for 
rhe ''Late” 
tr ear m ent 
groups . 
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Figui’e 2.9 Hypothesis C 

This analysis also assumes that the regression effect has 
taken place between the first and second administrations. 
Hypothesis C can be broken down into analyses of the same 
variables as Hypothesis B; these comparisons are summarized 
in Table VI. 

d. Hypothesis D 

This analysis tests for the longitudinal effect 
of training for the "early treatment groups," between the 
last two administrations after training (administration 3 
and administration 4), as shown in Figure 2.10. 




^ © © * © © 

Figure 2.10 Hypothesis D 
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TiBLS VI 

Su b-Hypor hes =s for H(C) 
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1 
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Null 

Hy poshes is: 


No change baivaaa 
a dminis - rat ions 2 
and 3 ("early" 
group) for: 


Method of 
Analysis 


H (Cl) 


Subordinate percaptinn 
of Suoarvisor * Problaoi 
Solving Support'. 




H (C2) 


Subordinate Perception 
of Supervisor "Passing 
the Buck". 




H(C3) 
H (C4) 


N ulti ple-cho ice 
Quest lonnair e 
score 

Subordinate Perception 
of Organization 
c lima te. 


T* * *n ^ — • 

X X r: CO , 

Ccppariscn 
of actual 

01 s a n s " 
b at w aer. 
Admin. 2 and 


H (C5) 


Subordinate 
S atis f act ion 


• Auui«n. j nor 
the '*early*’ 
tr eatmen t 
groups. 



H (C6) 


S ubor dinate 
Commitment 


H (C7) 


Supervisory Perception 
of Organization 




climate. 


H ( C8 ) 


S uper visor 
S atis fact ion 


H (C9) 


3 uper visor 
Com mi tment 
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This analysis also assumes that the regression effect has 
already taken place. Hypothesis D can be broken down into 
analyses of the same variables as Hypothesis C; these 
comparisons are summarized in Table VII. 
e. Hypothesis E 

This analysis tests for the longitudinal effect 
of training for the ’’late treatment groups," between the 
last two administrations after training (administration 3 
and administration 4), as shown in Figure 2.11. 

E 0X0 © © 




Figure 2.11 Hypothesis E 



This analysis also assumes that the regression effect 
has already taken place. Hypothesis E can be broken down 
into analyses of the same variables as Hypothesis D; these 
comparisons are summarized in Table VIII. 
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TABLE VII 

Su b-Hypot hesss for K(D) 



Null 

Hypothss is: 


Nc change between 
a dmin is ■- rat ior.s 3 
and 4 ("early" 
group) for: 


M s t h 3 3 of 
Analysis 


H (D1) 


Subordinate oercep-ion 
of Supervisor 'Problem 
Solving Support*. 




H (D2) 


Subordinate Psrceprion 
of SuDervisor "Passing 
the Buck". 




H (D3) 


Multi ole-cho ice 
Q uest icnnair 9 
Score 


T-Tssr : 
Coirpar i son 
of acr ua 1 


H ( D4 ) 


Subordinate Perceprion 
of Organization 
climans. 


xeans be^v^er. 
Ad mi Q • 3 ar. d 

Admin. 4 fir 
the early^* 
tr earm enr 
groups . 


H (D5) 


Subor dinars 
Satisfacricn 


H (D6) 


S ubor dinars 
Comm i trasr.t 




HTTJVr ~ 


S’upervisory Fsrceprion 
0 f‘ Or ganizat ion 
dime re. 




H (D8) 


S uper visor 
Saris fact ion 




H (D9) 


Ccmmitme nt 
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TABLE VIII 

Sub-Hypotheses for H(E) 



Mull 

H ypct hes is : 


Me chiige beeweeri 
a dmi’'; is~ re*- or.s 3 
and U ('•la-. 9" 
group) for: 


Method cf 
Ana lysis 


H (El) 


Subordinats peresprion 
of Sucervisor '?robl9in 
Solving Suppor-': •. 




H (E2) 


Subordinats Perceprion 
ct Supervisor "Passir'g 
the Buch". 




H (E3) 


Multiols-cho ice 
Quest iennair e 
score 


r-Test : 
Comparison 
of actual 


H (E4) 
H (E5) 


Subordinate Perception 
of Organization 
cliaa-te. 

S ubor dinar 9 
Satis faction 


~ ra — ngs* 

means 
between 
Admin. 3 a 
Admin. 4 f 

tr aa^oient: 
groups . 


H (E6) 


Subordinate 
Commi taent 




H (E7) 


Supervisory Perception 
of Organization 
c lima te. 




H (E8) 


S upsr visor 
S at is fact ion 




H (E9) 


S uoer visor 
Cciami tment 
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III. RESULTS 



A. REGRESSION RESULTS 

The study of the effect of the training on the early 
treatment groups was based on a comparison of the residuals 
developed from the regression analysis procedure discussed 
in chapter two. The regression analysis provided the values 
for the coefficient ”b" (slope) and the constant "a" (inter- 
cept) in the regression equation for each sub-hypothesis 
described in chapter two. In addition, analysis of variance 
provides an "F-ratio” which describes the strength of any 
linear relationship between administration one and adminis- 
tration two for the sub-hypotheses of interest (for the early 
treatment groups). Table IX provides a summary, of these 
values. The null hypothesis is that the slope = 0, that 
there is no relationship. A statistically significant rela- 
tionship justifies using the regression procedure. Except 
for "subordinate perception of supervisor 'passing the buck'" 
and "Multiple-Choice Questionnaire Score," a signifi- 
cant linear relationship is shown for each sub-hypothesis. 

For the non-significant items, a t-test can be used to 
determine if any differences exist between the early and 
late treatment groups' actual ratings on these items. 
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TABLE IX 

Regression Analysis Results 
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B. HYPOTHESIS A 



The first hypothesis examined was the null hypothesis of 
no training effect on the early treatment group, as deter- 
mined by a t-test between the residuals of the ratings for 
the early treatment group and the late treatment group at 
administration two. See Figure 3.1. 




Figure 3.1 Hypothesis A 

The results of these tests are shown in Table X. The column 
labeled "means" refers to the' mean value of the differences 
between the actual and predicted scores (difference, or 
residual, equals the actual score minus its predicted score). 
This difference is negative if the actual score is less than 
the predicted score. When this happens for the group that 
received the training, it indicates that the training has 
caused a reduction in the score used in the test of the 
sub-hypothesis. If the difference is posit-ive , it indicates 
that the training has caused an increase in the score. For 
those items showing a significant linear relationship for 
the late treatment group between administration one and 
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administration two, as discussed in the previous section, a 
comparison of the difference, or residual, means between the 
early and late treatment groups provides a measure of the 
significance of any changes noted. Table X shows the 
results of these comparisons. For those items not show’ing a 
significant linear relationship for the late treatment group 
between administration one and administration two, a compar- 
ison of the actual scores (for example, using a t-test ) is 
appropriate. Table XI provides the t-test results for these 
items, as well as t-test results for the other sub-hypotheses 
for comparison with the regression results. 

As shown in Table X, sub-hypotheses 3, 4, 5 and 6 indi- 
cate significance at least at the .065 level. Multiple-Choice 
Questionnaire Scores are above the predicted scores for the 
early treatment group, indicating that training had a posi- 
tive impact on supervisors' knowledge of the problem solving 
process. (As would be expected, because the linear rela- 
tionship between administration one and administration two 
for the late treatment groups' Multiple-Choice Questionnaire 
Scores was not significant, the t-test on the actual scores 
provided similar results. See Table XI.) Subordinate 
perception of organizational climate, satisfaction and 
commitment all show a significant decrease for the early 
treatment group (p > .065), indicating that the training had 
a negative impact on these ratings. 
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I&3L2 XI 

Actaal-Sccre T-test Results 



Mull Hyoothesis: 
No change between 
"early" and 
"late” grouDS fcr 
a n ui m n 3 T, r an r 0 n 2 


Means: 

Early 

La-^e 


•n ^ 

Value 


^ ^ c - * 

Pr cb , 


H (A1) 


Subordinate per- 
ion of Super- 
visor *?rofclezi 
Solving Support* 


4.5030 
4 .783 2 


-1.58 


92 .118 


K (A2) 


Subordinate Per- 
ceotion of Super- 
visor "Passing 
the Buck" 


2.6333 
2. 7324 


-0.23 


92 .822 


K (A3) 


Mult i pis -choice 

Questionnaire 

score 


0.5920 

0.3999 


2.72 


35 .010--^ 


H (A4) 


Subordinate Per- 
ception of 
Oraaniza t icnal 
Climate 


4.0373 
4. 47'4 7 


-2.4 7 


92 .015* 


H(A5) 


Subor dina te 
Satis fact ion 


4.3445 

4.9125 


-3.26 


38.40 .002* 


H (A6) 


Subordinate 

Commitment 


3.5435 


-2.41 


30.19 .018* 



3.9653 

H (A7) Supervisor Per- 

L ^ 1 ^ ^ r fj ^ 





Organ izat icnal 
Clima te 


4.0327 


0.26 


35 


. 797 


H (A8) 


Supervise r 


4. 8778 








Satis faction 


4.6526 


0.81 


27. 7 1 


. 426 




H (A 9) 


Super visor 
Commitment 


3.7222 


-2.39 


35 


.022* 



4. 5439 
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C. HYPOTHESIS B 



The second hypothesis examined is the null hypothesis of 
no treatment effect on the late treatment group, as deter- 
mined by a t-test on the ratings between administration two 
(immediately before the training) and administration three 
(immediately after the training). See Figure 3.2. 

' © * © © O 



^ © © 

Figure 3.2 Hypothesis B 

The results of these tests are shown in Table XII. In this 
and the remaining tables, "means" refers to the means of the 
actual scores or ratings. Most of the means show the appro- 
priate trends, but none except Multiple-Choice Questionnaire 
Score are significant below the .124 level. Multiple-Choice 
Questionnaire Score is the most significant (p > .087). 

D. HYPOTHESIS C 

The third hypothesis examined is the null hypothesis of 
no longitudinal change in the ratings for the early treat- 
ment group for the two administrations immediately following 
training (administrations two and three). See Figure 3.3. 
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Table XII 

T-Test Results for Sub-Hypotheses of H(B) 
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E 



0 X 0 



h(C) 



© 0 




Figure 3.3 Hypothesis C 

This analysis determined whether the after-training scores 
either declined or increased over time, and the significance 
of any differences. The results of this analysis are shown 
in Table XIII. The most significant difference is for 
sub-hypothesis six, subordinate commitment, which has 
increased from administration two to administration three 

I 

(p > .172). 

E. HYPOTHESIS D 

The fourth hypothesis examined is the null hypothesis of 
no longitudinal change in the after-training ratings for the 
early treatment group for administrations three and four. 

See Figure 3.4. 

E 0 X 0 



^ o © ^ . 0 © 

Figure 3.4 Hypothesis D 
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Table XIII 

T-Test Results for Sub-Hypotheses of K(C) 
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Note : 
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* identifies the most significant items. 



I 
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This analysis determined whether the after-training scores 
either declined or increased over time, and the significance 
of any differences. The results of this analysis are shown 
in Table XIV. The most significant result (p > .211) is for 
sub-hypothesis nine, supervisor commitment, which increased 
from administration three to administration four. 

F. HYPOTHESIS E 

The fifth hypothesis examined is the null hypothesis of 
no longitudinal change in the ratings for the late treatment 
group between the last two administrations following the 
training (administrations three and four). See Figure 3.5. 



E 0 >< © © © 




Figure 3.5 Hypothesis E 

This analysis used the same methodology as used for 
Hypothesis D. The results are shown in Table XV. The most 
significant result is for sub-hypothesis six, subordinate 
commitment (p > .113), which has increased from administra- 
tion three to administration four. 
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Table XIV 





T-Test Results for 


Sub -Hypo theses 


of H ( D ) 




Nul 
No 
adul 
3 a 
"ea 


1 Hypothesis: 
change between 
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Table XV 

T-Test Results for Sub-Hypotheses of H(E) 
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IV. 



DISCUSSION 



A. INTRODUCTION 

As mentioned in chapter two, the first portion of the 
research design developed for this project is described by 
Campbell's and Stanley's Design 10 [Ref. 3: pp. 46-50], a 

quasi-experimental non-equivalent control group design, 
which they state is one of the most widespread experimental 
designs in education research. The more the experimental 
and control groups are similar in their recruitment and the 
more this similarity is confirmed by scores on a pre- 
measure, the more effective this design is in controlling 
for the main effects of history, maturation, testing and 
instrumentation. One area of concern in this design is that 
of intrasession history. Since all of the subjects in each 
of the experimental groups are measured in two separate 
sessions, and the same for the control groups, the irrele- 
vant unique events in any of these sessions become rival 
hypotheses for explaining any pre-measure /post-measure 
differences for the two early treatment groups, the two late 
treatment groups or between the combined "early" groups and 
the combined "late" groups. Another major concern affecting 
internal validity is that of interaction effects of selec- 
tion and such extraneous factors as history, maturation and 
testing. In general, these interactions are unlikely, but 
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must be considered in the analysis. Regression can provide 
another source of internal validity problems in this design, 
especially if a matching procedure is used that results in 
substantially different group means. 

B. INSTRUMENTATION 

Four sets of questionnaires were administered during 
this training program to the supervisors or the subordi- 
nates, as appropriate, each attempting to measure some 
portion of the training effectiveness criteria (learning, 
behavior, reaction and results) discussed in Chapter Two. 
Since the main objective of the training program was to 
change supervisors' behavior to be more effective in dealing 
with problem-solving situations, the measures of the subor- 
dinates' perceptions of supervisors' behavior in using 
problem-solving skills is of primary interest. The measure- 
ment was done with the Subordinate Organization Survey (SUBQ) 
Part III. To simplify the analysis, this data was subjected 
to factor analysis and two factors were identified. One of 
the problems with aggregating data in this manner is the 
inability to diagnose specific strengths or weaknesses of 
the training program. Data aggregation is more useful, 
however, to explain why the overall results have occurred. 

The primary purpose of this thesis is to determine the 
overall effectiveness of the training program, so using the 
aggregated data appears to be appropriate. The factors 
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identified do seem to make sense and to be combining vari- 
ables measuring similar properties. The factor analysis was 
based on data from the first administration for che late , 
treatment group, and the same factors were used for all 
administrations for each group. The other data sets were 
used to assess the criteria of learning, reaction and 
results in order to explain the behavior ratings. Part II 
of the Subordinate Organization Survey and Supervisory 
Organization Survey measure some of the results criteria, 
such as organizational climate, satisfaction and commitment. 
The variables associated with these items were subject to 
factor analysis, with the result that one factor for each 
category was found to be appropriate. The disadvantage of 
aggregating the data, as noted earlier, is the inability to 
pinpoint a specific weakness for diagnostic purposes. The 
Multiple-Choice Questionnaire (MCQ) measured supervisors' 
knowledge of the problem-solving process and was scored on a 
right /wrong basis for each question. This researcher 
completed the questionnaire after reading the descriptive 
material for the training program, including the trainer's 
guide, and selected all the answers subsequently identified 
as correct by the company which developed the training 
package, providing a measure of face validity for the ques- 
tionnaire. By measuring the supervisors' learning (change 
in knowledge) of the problem-solving process after training, 
one source of behavior differences can be analyzed. The 
Supervisory Evaluation of Training Questionnaire (SETQ) 
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provides a measure of supervisor reaction to the training as 
well as a measure of intrinsic motivation and extrinsic 
support. Since this questionnaire was given only once 
(immediately after training) for each group, the only 
comparisons possible are between the early treatment group 
at administration two and the late treatment group at admin- 
istration three. These comparisons could be affected by the 
fact that the late treatment group completed the survey one 
month later than the early treatment group. 

C . SAMPLE 

The data comparisons are based on relatively small 
sample sizes, which affect the generalizability of the 
results to the population of all Coast Guard supervisors. 

In addition, the results may be contaminated due to the fact 
that subordinates usually rated more than one supervisor 
and that each supervisor was usually rated by more than 
one subordinate. This could, however, serve to increase 
the reliability of the overall ratings because of the 
multiple measurements for each supervisor. The area of 
greatest concern about contamination is the fact that some 
of the supervisors who received the training also completed 
surveys as subordinates. This could tend to bias the 
results, although the direction of bias is not predictable. 
The supervisors who are also subordinates and were exposed 
to the training could be either more critical after training 
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or more perceptive of the changes in their supervisors' 
behavior. The validity of this means of measuring supervi- 
sors' behavior is somewhat suspect. It is, however, the 
only measure of behavior available in this analysis. 

D. REGRESSION PROCEDURE 

The regression analysis described in Chapter Three, 

Table IX, indicates a linear significant relationship 
(p > .0060) between administration one and administration 
two for the late treatment group with respect to all sub- 
hypotheses of interest except sub-hypothesis two (subordi- 
nate perception of supervisors "passing the buck" with regard 
to problem solving, p > .1328) and sub-hypothesis three 
(multiple-choice questionnaire score, p > .8813). For these 
sub-hypotheses, application of the regression procedure would 
not be significantly different from measuring directly the 
differences in the actual scores between early and late 
treatment groups. The regression procedure used assumes 
that the initial means and standard deviations of the early 
and late treatment groups are the same. If this is not the 
case, results would be erroneous. A comparison of the 
actual score means for each sub-hypothesis found that the 
means and standard deviations did not differ significantly 
(at p > .05). Subordinate satisfaction and supervisor 
commitment showed the most significant differences p > .134 
and p > .100, respectively) between the means, and 
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subordinate satisfaction the most significant difference 
(p > .043) between the standard deviations. This will 
be considered in the discussion of the results of the 
comparisons of subordinates' satisfaction and of supervi- 
sors' commitment ratings. 

E. RESULTS 

1 . Behavior Criteria: Early Treatment Groups 

Hypothesis A examined the relationships between the 
early and late treatment groups after applying the regres- 
sion procedure in the case of each of the sub-hypotheses of 
interest. It was found that subordinate perception of 
supervisors' behavior was not significantly different after 
training for either of the two factors e.xamined. The most 
significant factor, "problem solving support" (p > .110), 
showed a decrease in the mean score, indicating that immedi 
ately after completion of the training subordinates felt 
that the supervisors' behavior was less effectively applied 
to problem solving than the behavior of the untrained super 
visors. This result could be partially due to the subordi- 
nates having higher expectations of their supervisors after 
completing the 4-week training package, since they were 
aware that the supervisors were being trained and in fact 
some of the subordinates were also considered to be supervi 
sors and received the training. The training could have 
made them more aware of the problem solving process and of 
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any differences between the ideal and the actual behaviors. 
This hypothesis can be viewed as a "negative Hawthorne 
effect," affecting the external validity of the results, 
as well as resulting in instrumental decay [Ref. 3] (the 
instrument no longer is measuring behavior with the original 
criteria), one of the conditions which affects internal 
validity. Although the results obtained indicate that the 
training had no significant impact on subordinate 
perception of supervisors' behavior, there are enough rival 
hypotheses to investigate as possible explanations of these 
results that a firm conclusion that the training is not 
effective is not possible without further study. For 
example, the validity of using the Subordinate Organization 
Survey Questionnaire instrument as the measure of supervisor 
behavior is suspect because of the factors mentioned above. 
In addition, there could still be differences in long-term 
behavior ratings, which were examined in Hypotheses C and 
D. In testing each of these hypotheses, however, there was 
no significant difference in supervisors' behavior. 

Another possible explanation is that the impact of 
training differed between the early treatment groups. 

Further data analysis was done comparing the regression- 
adjusted means at administration two for groups E3 and E5 
(see Figure 2.1) that showed a difference for the second 
factor ("passing the buck," p > 0.010), with the mean for 
group E3 decreasing (as desired for this factor) but 
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increasing for group E5 . There was no difference for the 
first factor. A t-test comparing the means of the actual 
ratings for group E3 between administration one and adminis- 
tration two showed a significant decrease (p > 0.006) for 
this second factor (not adjusted using regression proce- 
dure). Based on a comparison of the residuals t-tests and 
the actual-ratings t-tests of Hypothesis A (Tables XI and 
XII), it is believed that this strongly significant result 
would remain significant after the regression-procedure 
adjustment. There is no significant longitudinal change for 
group E3 on this second factor for the last two administra- 
tions, indicating that the training may have a lasting 
impact on this factor for group E3. In terms of behavior, 
this result indicates that the training was effective for 
one group on one factor, but overall made no difference. 

This information is useful for diagnostic purposes, but 
further discussion is beyond the score of this thesis. 

Another possible explanation for the lack of training 
impact on the early treatment group compared with the 
late treatment group at administration two could be related 
to demographic differences. Table XVI shows the mode for 
each of the categories of subordinate demographic data 
collected on the Subordinate Organization Survey Question- 
naire ( SUBQ , Part I) and for the supervisors, collected 
on the Supervisory Organization Survey Questionnaire (SUPQ, 
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Part I). A t-test comparing the means of the early and late 
treatment groups for each of these categories showed no 
significant differences. 
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2 . Behavior Criteria: Late Treatment Groups 

Hypothesis B examined the relationships between the 
early and late treatment groups' actual score means for the 
sub-hypotheses of interest. As shown in Chapter 3, Table 
XII, subordinates' perception of supervisors' behavior did 
not change significantly after training for either of the 
two factors examined. This result indicates that supervi- 
sors' behavior was not affected by the training program. As 
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discussed in the preceding section, however, there are many 
rival hypotheses to explain why training did not appear to 
have an impact on behavior. These include rising expecta- 
tions from the subordinates and their changing understanding 
of what is the ideal standard of behavior compared with 
reality ("instrumental decay"). The same possibilities for 
contamination exist for these late treatment groups as for 
the early treatment groups as discussed in the preceding 
section . 

The study of the longitudinal effects of training on 
supervisor behavior were examined in Hypothesis E, with no 
significant difference detected for the combined late treat- 
ment groups. Further data analysis was done to examine the 
rival hypothesis of differential impact of training on the 
late treatment groups. It was found that group L6 showed a 
significant increase (p > .055) in the ratings for factor 
one, "problem solving support." No significant differences 
were noted for group L4 on either factor or for L6 on the 
second factor. No significant longitudinal difference was 
noted for group L6 on factor one between administrations 
three and four, indicating a possible long term effect for 
this factor. As with the early treatment groups, this 
result indicates that the training was effective for one 
group on one factor, but overall made no difference on 
subordinate perception of supervisors' behavior. Further 
study to determine why there is a differential effect would 
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be useful for diagnostic purposes, but is beyond the scope of 
this thesis. 

3 . Learning Criteria 

If the training made no difference on supervisor 
behavior, a logical first step toward explaining why is to 
examine learning, the increase in knowledge as measured by 
the Multiple-Choice Questionnaire. Sub-hypothesis H(A3) 
examined the difference in knowledge after training for the 
early treatment group and sub-hypothesis H(B3) examined the 
differences for the late treatment groups. As shown in 
Chapter 3, Table X, there was a significant increase for the 
early treatment group (p > 0.010). For the late treatment 
groups, Table XII shows an increase significant at only the 
0.087 level. The mean scores, however, appeared to be 
fairly low. The mean score for the early treatment group 
was only 59% (9 of 15 correct) and for the late treatment 
group was 53% (8 of 15 correct) after training. Group E3 
showed a significantly higher mean score (p > .100) than 
group E5 (67% vs. 47% correct) after training. For the late 
treatment groups, C6 showed a significant increase in knowl- 
edge (at the .029 level) to 70% correct, while L4 showed no 
significant increase and a mean score of 37% after training. 
These results follow the results in the previous sections, 
indicating that the training was effective for groups E3 and 
L6 , but overall was ineffective. Although when this number 
of hypotheses are tested some are bound to be significant by 
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chance, it is felt that the consistency of this particular 
finding (both behavior and knowledge were found to be 
significantly higher for groups E3 and L6 ) gives it more 
credibility than it might otherwise merit and should be 
considered for diagnostic purposes. 

4 . Results Criteria 

Results criteria in terms of subordinates' and 
supervisors' views of organizational climate, satisfaction 
and commitment to the Coast Guard were measured by Part II 
of both the Subordinate Organization Survey and the 
Supervisory Organization Survey questionnaires. For the 
early treatment groups, sub-hypotheses H(A4), H(A5) and 
H(A6) examine the results criteria for subordinates, and 
sub-hypotheses H(A7), H(A8) and H(A9) examine these criteria 
for the supervisors. As shown in Table X, there is no 
significant change for the supervisors on these criteria, 
but for the subordinates there is a significant decrease 
immediately after training for all three categories. 
Hypotheses C and D examined the longitudinal effects for 
these sub-hypotheses. At administration three, as shown in 
Table XIII, subordinate commitment shows the most signifi- 
cant change (p > .172), moving slightly upward. At adminis- 
tration four, as shown in Table XIV, supervisor commitment 
shows the most significant change (p > .211), also moving 
slightly upward. In summary, for the early treatment 
groups, there appears to be no change for the supervisors 
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and a negative change for the subordinates in terms of the 
results criteria. 

For the late treatment groups, sub-hypotheses H(B4), 
H(B5) and H(B6) examine the results criteria for subordi- 
nates and H(B7), H(B8) and H(B9) examine the criteria for 
the supervisors. As shown in Table XII, there is no signif- 
icant change in any of these cases immediately following 
training. Hypothesis E examines the longitudinal effects 
for these sub-hypotheses. As shown in Table XV, subordinate 
commitment shows a slight increase (p > .113) for adminis- 
tration four. 

These results indicate a difference in the reception 
by the subordinates between the early and late treatment 
groups. Perhaps the implementation of practice of the 
problem solving skills was handled differently between the 
early and late treatment groups. Further study of this 
issue, as well as investigation of possible differential 
effects between the "early” groups and between the "late" 
groups, would be useful for diagnostic purposes. Within the 
scope of this research, it appears that training has not 
had a positive impact on these results criteria, and for the 
early treatment group, the impact on these criteria has been 
negative . 

F. CONCLUSIONS AND RECOMMENDATIONS 

The overall results of this analysis indicate that the 
training package was not effective in changing the 
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supervisors' behavior; it had moderate success in teaching 
a knowledge of the problem solving process; it had a negative 
impact on subordinate perception of organizational climate, 
satisfaction and commitment to the Coast Guard for the early 
treatment group and no significant impact on these criteria 
for the late treatment group. Figure 4.1 through Figure 
4.9 provide a summary of the results of the study of the 
sub-hypotheses considered in this analysis. A "+" or 
indicates the direction of change. Without further 
study investigating the reasons why behavior change did not 
occur for all treatment groups, the results of this study 
suggest that the U.S. Coast Guard implementation of this 
training package should not proceed. 
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Figure 4.1 Problem Solving Support 
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Figure 4.2 Passing the Buck 




Figure 4.3 Multiple-Choice Questionnaire Score 
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Figure 4.5 Subordinate Satisfaction 
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Figure 4.6 Subordinate Commitment 
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Figure 4.8 Supervisor Satisfaction 
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Figure 4.9 Supervisor Commitment 
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APPENDIX A 



QUESTIOxNNAIRE CODING 

A. INTRODUCTION 

This appendix relates the four survey instruments used 
to study the effectiveness of the "Problem Solving Skills 
for Managers" training package to the variable names and 
value labels assigned to the SPSS System File developed to 
facilitate the analysis. Four separate files were 
established, one for each survey instrument. They are: 

SUBQ (Subordinate Organization Survey); SUPQ (Supervisory 
Organization Survey); MCQ (Multiple Choice Questionnaire); 
and SETQ (Supervisory Evaluation of Training Questionnaire) 
The questionnaires were administered according to the 
following schedule; 



Stat ion 


E300 


A1 


X 


A2 




A3 


A4 


Station 


E500 


A1 


X 


A2 




A3 


A4 


Station 


L400 


A1 




A2 


X 


A3 


A4 


Station 


L600 


A1 




A2 


X 


A3 


A4 



A1 refers to the first administration, A2 to the second 
administration and so on. SUBQ, SUPQ, and MCQ were filled 
out at all four administrations. SETQ was filled out only 
in the administration immediately following treatment 
(designated by "X"). 
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B. SUBORDINATE ORGANIZATION SURVEY 

This questionnaire was given to subordinates of the 
supervisors who were trained or scheduled to be trained as 
part of the study to measure how supervisors in the Coast 
Guard work with their subordinates. The first five ques- 
tions asked for some biographical data of the survey 
respondents. SUBQ106A through SUBQ108C asked for the 
subordinates' attitudes or opinions about what it is like 
to work in the Coast Guard. The remaining questions dealt 
specifically with how the subordinates' supervisors and 
others work with them. 
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UNIT 




USCG 


(1-4 


£ U B Q 


(6-9 


A D M I N _ 


_ (10) 


UNIT 


'12- 



INTERACT PERFORMANCE SYSTEMS, INC. 
SUBORDINATE ORGANIZATION SURVEY 



IMPOITANT PLEASE READ 

This questionnaire is being given to you as part of a study to measure how 
supervisors in the Coast Guard work with their subordinates. There are 
three parts to this questionnaire. Part I asks you some basic questions 
about yourself. This helps us make sure that different units in the Coast 
Guard are included in a fair way. Part II asks for your attitudes or 
opinions about what it's like to work in the Coast Guard. Part III asks 
very specific questions about how your supervisor and others work with you. 

All of your answers will be strictly confidential. Only the researchers at 
Interact Performance Systems will have access to your questionnaire. 



This questionnaire will be repeated in a few months, and we would like to 
learn your views at both times. In order to follow your responses over the 
months and at the same time. make sure you remain anonymous, we ask that you 
code each questionnaire in the following way: 



1. Print the first letter of your Mother ' s 

first name 

2. Print the first letter of your Father ' s 

first name 

3. Print the two numbers which represent the 
day of the month of your birthday . . 

Please note example: 



If your mother's name is ^ry Smith ^ M 

If your father's name is Robert Smith put an R 
in the space. Please do not put a B even if his 
nickname is Bob 5. 

If you were bom on the 16th of the month. . ^ 1 S 

Or if you were bom oa the 5th of the month. . . » 0 5 



(17-20) 



(Please include a zero in the first space if you were born before the 
10th of the month.) 



Name of your current supervisor: 



(21-24) 



Renrinted With Permission 
Co'pyngnt, Interact Performance Systems, Inc. 1982 

All Rights Reserved 
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DESTRUCTIONS 



1. Most questions can be ans*wered by choosing one of the answers given. If 
you do not find the exact answer that fits your case, choose the one 
that is closest to it. 



2. Answer questions by circling the number of your answer choice, as shown 
in this example. 



Q: To what extent are you satisfied with the 



car you drive? 



12 3 




7 



(A response of ’5" would mean that you are satisfied with the 
car you drive somewhere between "some extent" and "great 
extent" but closer to "some extent.") 



3. Be sure each answer is clearly coarked. 



PLEASE ANSWER EVERY QUESTION 
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PART I 



Page 



5U5Q1Q1 
‘ 1. Age? 



a. 


under 


20 


f. 


40 


to 44 


b- 


20 to 


24 


g- 


45 


to 49 


c. 


25 to 


29 


h. 


50 


to 54 


d. 


30 to 


34 


i. 


55 


and over 


e. 


35 to 


39 









SUBQ102 

2. Sex? 

a. Female 

b. Male 

SUBQ103 

3. Years In the Coast Guard? 






(26) 


a. Less than 1 ’ 


f. 


5 to 7 


(27) 


b. One 


g* 


8 to 10 




c. Two 


h. 


11 to 15 




d. Three 

e . Four 

SUBQ104 

4. Years in current assignment? 


i. 


More than 15 




a. Less than 1 


f. 


5 to 7 


(28) 


b. One 


g* 


3 to 10 




c. Two 


h. 


11 to 15 




d. Three 

e. Four 

SUBQ105 

5. Time spent working for your current 


i. 

supervisor? 


More than 15 




a. Less than 3 months 


f. 


5 to 7 years 


(29) 


b. 3 to 6 months 


g- 


8 to 10 years 




c. 7 to 11 months 


h. 


11 to 15 years 




d. 1 to 2 years 
j. 3 to 4 years 


i. 


More than 15 years 
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Page 4 



PART II 



This part of the survey contains questions about what it's like to work for 
the Coast Guard. Once again, your responses will be confidential. 



To what extent: 

SUBQ106. a. Do the supervisors and those senior to them 
at this unit have an interest in the well 
being and morale of the people who work here? 



z f ^ 

•3 w X 




O O U 

Z o 

1 2 3 4 5 6 7 



(30) 



SUBQ106b. Do the supervisors and those senior to them 
at this unit try to in?>rove working 

conditions? 1234567 



SUBQ106c. Do your supervisors and those senior to them 
at this unit schedule the work that needs to 

be done with the subordinates in mind? 1 2 3 4 5 6 7 



SUBQ106d. Do you feel motivated to give your best 
effort to the Coast Guard? 



1 2 3 4 5 6 7 



SUBQ106e. Do people who do the roost on their jobs get 
rewarded the most? 



1 2 3 4 5 6 7 



SUBQ106f. 


Are there things about working here that 
encourage you to work hard? 


SUBQ106g. 


Are decisions regarding the way work gets 
done made by those who have the best 
information? 


SDBQ106h. 


Is information in this unit widely 
shared so that those who make decisions 
have access to all available know-how? 


SUBQ106i. 


Is the amount of information you get about 
what is going on in your division adequate 
for ycu to do a better job? 


SUBQ106J. 


Do you get the information you need about 
your own job in order to do your job in the 
best way? 


SUBQ106k. 


Is your supervisor willing to listen to your 
ideas and suggestions? 


SUBQ1061, 


Are those above your supervisor open to your 
ideas and suggestions? 



1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 (41) 
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Page 5 



SUBQ106 problecB discussed ia a professional and 

helpful manner? 

SUBQ106 ^ supervisors and those senior to them shew 
concern and understanding for people when 
talking about problems? 



12 3 4 



3 5 6 7 



(42) 



All in all, how satisfied are you with: 

SUBQIO 7. a* The people in your division? 

SUBQlOTb. With people in the Coast Guard who are 
outside your division? 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



SUBQ107C. 

SUBQ107d. 

SUBQ107e. 

SUBQ107f. 



With your supervisor? 

With your job? 

With your pay? 

With the way problems get solved in your 
division? 



1 2 3 4 5 6 7 
1 2 3 4 5 6 7 
1 2 3 4 5 6 7 

1 2 3 4 5 6 7 



To what extent: 



SUBQIO 8. a. Would you consider taking a job similar to 

the one you now have (outside the Coast Guard), 
in the same city, with no loss of benefits, 

and with a 10% raise in pay? 1 2 3 4 5 6 7 

SUBQIO 8b. Are you glad you chose the Coast Guard for 

a career over the other career opportunities 

you might have had? 1 2 3 4 5 6 7 



SUBQIO 8c. Are you coanhtted to working for the Coast Guard 
SLS long as your personal situation (your 
health, spouse's or family's needs, etc.) 

allows you to? 1 2 3 4 5 6 7 (52) 
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PART III 



The last section focused on your opinions and feelings . This section 
focuses on your observations. 

The following questions refer to how your supervisor deals with problems in 
your division. 



To what 


extent; 


SUBQ109- a. 


Does your supervisor keep up>- to-date with 
theproblemsyouare experiencing on the job? 


SUBQ105b. 


Does your supervisor take time discussing 
your point of view on your work? 


SUBQ109fc. 


Does your supervisor take time to ask you 
whether there are ways he or she can help 
make your job easier? 


SUBQ109ti. 


Does your supervisor come to your work area 
to ask you whether you need any help to make 
your job easier? 


SUBQ109e. 


Does a problem have to get out of hand before 
your supervisor chooses to deal with it? 


SUBQ109f. 


Does your supervisor fail to deal with 
problems before they become severe? 


SUBQ109S- 


Does your supervisor give you excuses for not 
solving problems that show you he or she 
won't "go to bat" for you? 


SUBQ109h, 


Is your supervisor unwilling to argue or 
fight for you to solve problems you bring up? 


SUBQ1091. 


Does your supervisor refuse to take on the 
people in power in order to remove 
complaints in your department? 


SUBQ109j. 


Is your supervisor supportive in solving work 
related problems you want help with? 


SUBQ109ii. 


Does your supervisor bring resources to bear 
to help you solve problems on the job? 




K 

Oi 



1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 



( 53 ) 



( 63 ) 
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SUBQ1091. 


1) 

'O ■— 

Does your supervisor say he or she will take ^ | 2 ^ 

action on a problem but then never get back - ° ^ ^ 

to you to solve it? 1 2 3 4 5 6 7 (64) 


SUBQlO'aa. 


Does your supervisor premise to see wnat can 
be done about a problem but then never let 

you know what he or she did to solve it? 1 2 3 4 5 6 7 


SUBQ10%. 


Is your supervisor quick to follcw through 

on problems you bring to his or her attention? 1 2 3 4 5 6 7 


SUBQ10?b. 


Does your supervisor take action in a timely 
way to solve complaints you bring to his or 

her attention? 1 2 3 4 5 6 7 


SUBQ10%). 


Does your supervisor get on your case too ouch 
about little things that are not worth the 

time they'd take to fix? 1 2 3 4 5 6 7 



10. Talking About Problems on the Job 



SUBQllOa. 


When your supervisor brings up a problem, 
to what extent is he or she clear about 

exactly what is bothering him or her? 1234567 


SUBQllOb. 


To what extent is your supervisor clear 

about the facts of problems? 1 2 3 4 5 6 7 

(That is, to what extent does he or she use 
specific statements such as, ”You filed the 
Jones file under the K's" Instead of vague 
statements such as, 'You aren't filing these 
correctly.") 



11. Talking About Problems 



SUBQllla. 


To what extent does your supervisor put you 

down when describing problems? 1 2 3 4 5 6 7 


SUBQlllb. 


To what extent does your supervisor draw 
conclusions about you as a person when 

discussing problems? 1 2 3 4 5 6 7 (72) 

(That is, to what extent does he or she say 
things about you like, 'You're lazy, you've 
got a bad attitude, you're incompetent," 
instead of just describing what is wrong with 
the job?) 
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12. Listening to You 



When you talk with your supervisor about work, 
to what extent does he or she: 

SUBQllZa. Listen to your point of view without 
interrupting or cutting you off? 

SUBQ112 b. Demonstrate by restating that he or she 

fully understands the point you are trying 
to make? 

SUBQ112 c. Accurately sunmarize your feelings on the 
matter? 

SUBQ112 d. Carefully listen without arguing or becoming 
upset? 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



(73) 



13. a. To what extent does your supervisor impose a 
solution to a problem without first stopping 
to figure out what is going on? 

SUBQ113 b. To what extent does your supervisor ’’shoot 
from the hip" when solving problems instead 
of stopping to learn about the problem first? 

SUBQ113 c. To what extent does your supervisor blame you 
for problems that aren't your fault? 

SUBQ113 b. When discussing a problem with you, to what 
extent does your supeit/isor assume you're 
the cause of the problem when you're not? 



1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 



(80) 



CARD 2 



14. Explaining the Reasons Why Something Must be Done 
a Certain Way 

SUBQ1143.. When discussing a problem, to what extent 
does your supervisor clearly explain what 
would go wrong with the job if the problem 
weren't corrected? 

SUBQ114b. To what extent does your supervisor explain 
how correcting a problem affects the job? 



1 2 3 4 5 6 7 (25) 



1 2 3 4 5 6 7 (26) 
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15. Answering Questions About Why Sooething Must be 
Done a Certain Way 

SUBQllS^* When answering questions about why something 
must be done a certain way, to what extent 
does your supervisor order you to do it the 
way he or she wants? 

SUBQ115b. When answering questions about why something 
must be done a certain way, to what extent 
does your supervisor threaten you with what 
might happen if you don’t do what he or she 
wants? 



1 2 3 4 5 6 7 



(27) 



1 2 3 4 5 6 7 



SUBQ115^* answering questions about why scroething 

must be done a certain way, to what extent 
does your supervisor use his or her "stripes” 
as your supervisor to get you to do what he 

or she wants? 1 2 3 4 5 6 7 



16. Respecting your Ideas 

SUBQ116a. To what extent does your supervisor treat you 
in a way that shows he or she values your 

experience and opinions on the job? 1 2 3 4 5 6 7 

SUBQ116b. To what extent does your supervisor show 

respect for your ideas and abilities on the 

job? 1 2 3 4 5 6 7 



17. To what extent: 

SUBQ117a. Does your supervisor try to find ways to 

make the job easier in the future? 1 2 3 4 5 6 7 

SUBQ117b. Is your supervisor concerned about naking 
the job less difficult the next time you 

have to do it? 1 2 3 4 5 6 7 (33) 



86 



Page 10 



18. After ycxi and your super/1 sor have discussed a 
problem, to ^-hat a\tent: 



b. 



SUBQllSa. 

SU3Q118 
SUBQllS'^ 

SUBQllS'^ 



Does your supervisor leave you guessing about 
what should happen next? 

Is it left unclear as to who will do what to 
solve the problem? 

Can you be sure that your supervisor will 
really followup to see that the problem is 
solved? 

Are you able to trust that your supervisor 
will do what the two of you have agreed 
needs to be done? 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



(34) 



19. Dealing with an Upset Subordinate 



Sn^0119^* dealing with an upset subordinate, 

to what extent does your supervisor get 
angry him or herself?* 



SUBQ119b. When dealing with an upset subordinate, 
to what extent does your supervisor 
get into an argument? 

SUBQ119c. When dealing with an upset subordinate, 
to what extent does your supervisor ask 
what has made the person upset or angry? 



SUBQ119d. When dealing with an upset subordinate, 
to what extent does your supervisor 
ask the person what is bothering him 
or her? 



1 2 3 4 5 6 7 
1 2 3 4 5 6 7 
1 2 3 4 5 6 7 

1 2 3 4 5 6 7 (41) 
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20. Doing ’^ell cn the Job 2 | 



3UBQ12Ca. 


5J <n 

When you have done well on the job, to what 1 J J 

extent does your supervisor simply ignore 

what you have done? 1 2 3 4 5 6 7 (42) 


SUBQlZOb- 


When you have done a good job, to what extent 
does your supervisor express his or her 

appreciation for what you have done? 1234567 



21. To what extent 



SUBQlZla. 


Does your supervisor act in ways that nake 

it hard to trust him or her? 1 2 3 4 5 6 7 


SUBQlZlb. 


Does your supervisor tell you whatever he or 
she thinks you want to hear in order to get 

you to do what he or she wants? 1 2 3 4 5 6 7 (45) 
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C. SUPERVISORY ORGANIZATION SURVEY 

This questionnaire was given to supervisors who were 
trained or scheduled to be trained as part of the Problem 
Solving Skills for Managers Training Program. The first 
five questions asked for some biographical data of the 
survey respondents. SUPQ106A through SUPQ108C asked for 
the supervisors' attitudes or opinions about what it is 
like to work in the Coast Guard (i.e. Organizational 
Climate, Satisfaction and Commitment). The remaining 
questions dealt with the supervisors knowledge of problem 
solving and their perceptions of organizational support. 
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; 1 “^ ) 

( 6 - 9 ) 
( 10 ) 
(12-15) 

INTERACT PERPCaMANCE SYSTEMS, EC. 

SUFERVISCRY OIGANI2ATION SURVEY 



USCG 

s u p c 

A D M I N 

UNIT 



IMPORTANT PLEASE READ 



This questionnaire is being given to you as part of a study to measure your 
opinions and observations about your work. All your answers will be 
strictly confidential . Only the researchers at Interact Performance Systems 
will have access to your questionnaire. 

This questionnaire will be repeated in a few months, and we would like to 
learn your views at both times. In order to do this, please print your name 
in the space below. 



Name: 



(17-20) 



Once again, only the researchers at Interact Performance Systems will have 
access to your survey. 



Reprinted With Permission 
Copyright, Interact Performance Systems, Inc., 1982 
All Rights Reserved 
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INSTRUCTIONS 



1. Most questions can be answered by choosing one of the answers given. If 
you do not find the exact answer that fits your case, choose the one 
that is closest to it. 



2. Answer questions by circling the number of your answer choice, as shown 
in this example. 



Q: To what extent are you satisfied with the 



car you drive? 



12 3 




(A response of "S" would mean that you are satisfied with the 
car you drive somewhere between ’’some extent*’ and ’’great 
extent” but closer to ’’some extent.”) 



3. Be sure each answer is clearly marked. 



PLEASE ANSWER EVERY QUESTION 
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SUPQIOI 



i . Age? 






(25) 


a . under 20 


f. 


40 to 44 




b. 20 to 24 


g- 


45 to 49 




c. 25 to 29 


h. 


50 to 54 




d. 30 to 34 

e. 35 to 39 


i. 


55 and over 




SUPQ102 
2. Sex? 






(26) 


a. Female 

b. Male 








SUPQ103 

3. Years in the Coast Guard 






(27) 


a. Less than 1 


f. 


5 to 7 




b. One 


g* 


8 to 10 




c. Two 


h. 


11 to 15 




d. Three 

e. Four 


i. 


More than 15 





SUPQ104 



4. Years in current assignment? 






(28) 


a. 


Less than 1 


f . 


5 to 7 




b. 


One 


g* 


8 to 10 




c. 


Two 


h. 


11 to 15 




d. 


Three 


i. 


More than 15 




e. 


Four 









SUPQ105 

5. Time spent working for your current supervisor? (29) 



a. 


Less 


than 3 months 


f. 


5 to 7 years 


b. 


3 to 


6 months 


g- 


8 to 10 years 


c. 


7 to 


11 months 


h. 


11 to 15 years 


d. 

e. 


1 to 
3 to 


2 years 
4 years 


i . 


More than 15 years 
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PART II 

This part of the suir/ey contains questions about what it’s like to work for 
the Coast Guard. Once again, your responses will be confidential. 



To what 


extent: 


SUPQIO 6. a. 


Do the supervisors and those senior to them 
at this unit have an interest in the well 
being and morale of the people who work here? 


SUPQ106b. 


Do the supervisors and those senior to them 
at this unit try to improve working conditions? 


SUPQ106C. 


Do the supervisors and those senior to them at 
this unit schedule the work that needs to be 
done with the subordinates in mind? 


SUPQ106d. 


Do you feel motivated to give your best 
efforts to the Coast Guard? 


SUPQ106e. 


Do people ^ho do the most on their jobs get 
rewarded the most? 


SUPQ106f. 


Are there things about working here that 
encourage you to work hard? 


SUPQ106g. 


Are decisions regarding the way work gets 
done made by those who have the best 
information? 


SUPQ106h. 


Is information in this unit widely 
shared so that those who make decisions 
have access to all available know-how? 


SUPQ1061. 


Is the amount of information you get about 
what is going on in your division adequate 
for you to do a better job? 


SUPQIO 6j. 


Do you get the information you need about 
your own job in order to do your job in 
the best way? 


SUPQlOac. 


Is your supervisor willing to listen to your 
ideas and suggestions? 


SUPQ1061. 


Are those above your supervisor open to your 
ideas and suggestions? 



Ol 

Oi 

I 

o 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 

2 3 4 5 6 



7 

7 



7 

7 

7 

7 



7 



7 



7 



7 

7 

7 



(30) 



(41) 
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SUPQ106 m. 
SUPQ106 n. 



All in 
SUPQ107. a. 
SUPQ107 b. 

SUPQ107 c. 
SUPQ107 d. 
SUPQ107 e. 
SUPQ107 f. 



To what 
SUPQ108. a. 

SUPQlOSb. 

SUPQ108C. 



Are problens discussed In a professional and 
helpful uanner? 

Do your supervisors and those senior to them 
show concern and understanding for people 
when talking about problems? 



all, how satisfied are you with: 
The people in your division? 



1 2 3 4 5 6 



1 2 3 4 5 6 



a, 

j=; T? 



1 2 3 4 5 6 7 



With people in the Coast Guard who are out- 
side your division? 1234567 



With your supervisor? 



1 2 3 4 5 6 7 



With your job? 



1 2 3 4 5 6 7 



With your pay? 



1 2 3 4 5 6 7 



With the way problems get solved in your 

division? 1 2 3 4 5 6 7 



extent: 



Would you consider taking a job similar to 
the one you now have (outside the Coast Guard),- 
in the same city, with no loss of benefits, 

and with a 10% raise in pay? 1 2 3 4 5 6 7 



Are you glad you chose the Coast Guard for 
a career over the other carreer opportunities 

you might have had? 1 2 3 4 5 6 7 



Are you corrmitted to working for the Coast 
Guard as long as your personal situation 
(your health, spouse's or family's needs, 

etc.) allows you to? 1234567 



(52) 
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This part of the survey contains questions about different approaches you 
might use to solve problems on the job. Different training programs 
recommend different approaches to solving problems, but we are interested in 
your opinion as to which approaches you find useful in the Coast Guard. 



1. When beginning a problem solving discussion with 
a subordinate, to what extent do you feel it is 
useful to: 



SUPQ109a. Begin the discussion by noting what the sub- 
ordinate is doing well before bringing up 
the problem? 

SUPQ109b. Begin by discussing the facts and details of 
the problem so that you won’t get into an 
argument about w'hat happened? 

SUPQ109C* Begin the discussion by asking what is going 
on so that the subordinate will feel free to 
discuss his or her concerns? 



0» 

E 

o 

Lin 



1 2 3 4 5 6 7 (53) 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



2. To help a subordinate overcome a problem that is 
preventing him or her from doing his or her job, 
to what extent do you feel it is useful to start 
by: 

SUPQllO* Finding someone with more experience or know- 
ledge than the subordinate to help him or her 

with the job? 1 2 3 4 5 6 7 



SUPQllCb- Asking the subordinate what he or she thinks 
is the best way to solve the problem? 

SUPQllCP* Using your own skill to decide what needs to 
be done and have the subordinate do it? 



1 2 3 4 5 6 7 

1 2 3 4 5 6 7 



(58) 
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3. When subordinates complain about doing a Job 
that is hard but necessay to do, to -fthat ex- 
tent do you feel it is important to: 

SUPQlll a. Maintain control by focusing on the specific 
■ disciplinary actions you could take? 



1 2 3 4 5 6 7 



SUPOlll Remind them they work under you and that it’s 

^ your job to make the decisions? 

SUPQlll c. Stay on top of the situation by telling 

them that they must do the job the way you 
tell them to? 



1 2 3 4 5 6 7 

1 2 3 4 5 6 7 



SUPQlll d. Let them knoj^ you will help them later if 
they help you now? 

SUPQlll e. Promise them some sort of reward for putting 
out the extra effort? 



1 2 3 4 5 6 7 

1 2 3 4 5 6 7 



SUPQlll f. 



Remind them of what could happen to the job 
if they do not put out the extra effort? 



1 2 3 4 5 6 7 



(59) 



4. When one of your subordinates gets upset or 
angry, to what extent do you feel it is useful 
to: 



SUPQ112 2.* Inform the subordinate of the disciplinary 
actions you will take if he or she doesn’t 
control his or her temper? 

SUPQ112t). Ask the subordinate to cool off before 
discussing the matter with you? 

SUPQ112C* Ask the subordinate to go for a walk, get a 
drink, or take a break so that he or she 
will be less emotional when you discuss the 
problem? 



1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 



SUPQ112^^* Avoid getting into the subordinate's emotions 
by focusing on the job? 



1 2 3 4 5 6 7 



SUPQ112 details about what is making the 

subordinate upset? 



1 2 3 4 5 6 7 



SUPQ112 Tell the subordinate you have felt the same 
way before and that you s^nnpathize with his 

or her anger? 1 2 3 4 5 6 7 



(70) 
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5. When you have to deal with a tou^ problem or a 
touchy situation with one of your subordinates, 
to what extent do you: 

SUPQ113a. Feel stress or tension? 

SUPQ113b. Feel confident and sure? 

SUPQ113c. Feel annoyed or irritated? 



1 2 3 4 5 6 7 
1 2 3 4 5 6 7 
1 2 3 4 5 6 7 



(71) 



6. To what extent do your subordinates: 

SUPQll4a. Create problems you have to solve? 

SUPQ114b. Need to be watched if they are to put out 
their best effort? 

SUPQ114C- Need to be told what to do next on the job? 

SUPQ114<^* Lack the ability or experience to do their 
• jobs without your guidance? 

SUPQ114®* ^ appear ’’innocent" instead of taking 

responsibility for probleriB they have caused? 

SUPQ114f* Give questionable or unlikely excuses to 
avoid blaine? 

SUPQ114S* Try to undermine your respect and authority? 

SUPQlUh. Act in ways that question your leadership? 

SUPQ114i. Take offense at little things that shouldn't 
matter? 

SUPQ114j* Get angry or defensive without good reason? 

SUPQ114^* frustrated too easily when a difficult 

job mist be done? 

SUPQ1141. Try to take advantage of you if you try to 
be their friend? 



1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 (80) 

{ CARD 21 

1 2 3 4 5 6 7 (25) 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 (29) 
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7. To wbat extent: 



SuPQll^- 


Is just doing a good job inroortant to your 
subordinate? 


SUPQ115^- 


Do your subordinates take an interest in 
doing their best on the job? 


8. To 


what extent do you: 


SUPQ116 a. 


Set aside extra time each day to ask sub- 
ordinates about problems in their work areas? 


SUPQ116 b. 


Sit down and plan how you will solve a prob- 
lem with a subordinate before going out and 
solving it? 


SUPQ116 c. 


Rehearse in your mind what you will say to a 
subordinate before starting a problem-solving 
discussion? 


SUPQ116 d. 


Pause to list in your head what the results 
of a problem might be before discussing the 
problem with a subordinate? 


SUPQ116 e. 


Stop to think of all the reasons a job needs 
to be done a certain way before discussing 



the job with a subordinate? 



c a- 

X cu 

O' 

O) 

E 0> 

O w 

LTt O 

3 4 5 6 7 (30) 

3 4 5 6 7 (17) 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 (36) 



1 2 
1 2 
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9. To what extent cio other supervisors you work 
with: 



SnpQliya. Discuss problems with you before the problem 
gets out of hand? 



1 2 3 4 5 6 7 (37) 



SUpQl 1 7 b. Ask for your point of view as to 'Ahat is 
causing a problem? 

5 UPQ 117 C* Work with you instead of blaming you when 
problems cofre up. 



SupQiiyd. Discuss problems without becoming upset or 
raising their voices? 

SUPQ117e. Show respect for your experience and 
expertise? 

SUPQ117f. Follow through on their ccmmitments to you? 



SUPQ117g. ”Go to bat” for you by taking on others 
when it is required? 



1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 



SUPQllTh. Take action on problems that you bring to 
their attention? 



1 2 3 4 5 6 7 



10. To what extent does your supervisor: 



SUPQ11&-* Discuss problems with you before the problem 
gets out of hand? 

SUPQ113^- Ask for your point of view as to what is 
causing a problem? 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



SUPQllS:^- Work with you instead of blaming you ^en 
problems come up? 

SUPQllSi- Discuss problems without becoming upset or 
raising their voices? 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



SUPQll^- Show respect for your experience and 
expertise? 



SUPQll^* Follow through on their coimitments to you? 

<;Tipm 1 ^ ^Dr ycu by taking on the others 

when it is required? 

SUPQ113i» Take action on problems that you bring to 
their attention? 



1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 



(52) 
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D. MULTIPLE CHOICE QUESTIONNAIRE 



This questionnaire v/as given to supervisors who were 
trained or scheduled to be trained as part of the Problem 
Solving Skills for Managers Training Program. MCQIOI 
through MCQ115 measured the supervisors' knowledge about 
problem solving. The remaining questions dealt with the 
supervisors' recognition of opportunities to use problem 
solving skills. 
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UNIT 



A D M I 1 ] 



( ^ } 

111 - 14 ) 




Name: 



INTERACT PERFmiANCE CfSTBSS 



MULTIPLE CHOICE QUESTIONNAIRE 



( 16 - 20 ) 



The following questions provide sitiiations you might face 
at work, and give five different ways you might respond to 
them. Pick the one best response by circling the number 
in front of it. 



MCQIQI 

A. You notice a person who has been working for you only a short period of 
time using the wrong form for an important report You approach him or 
her and state: 

1. 'TDo you need any help on this?" 

2. 'You're using the wrong form for this report. Is there anything we 
can do to avoid this happening in the future?" 

3. 'T notice you are using the CG 3312A form and this report calls for 

theOG 3307 form," (25) 

4. "When you use the CG 3312A form we don’t get the information 
required by by District." 

5. 'Ts there anything I can do to help you learn which forms to use for 
the different reports ycu prepare?" 



MCQ102 

B. in talking with a subordinate, you become aware of a rather complicated 
problem. You have a fairly good idea why the problem exists, but are 
not totally certain. 

1. 'You seem to be having a problem with ... Is it because of . . .?" 

2. "Here is what I' think is causing the problem . . . What do you 
think?" 

3. 'Thanks for pointing the problem out- I’ll check into it and get 

back with you later this afternoon." (26) 

4. 'Thanks for pointing the problem out. Do you want me to get you 
some help to solve it?" 

5. "What do you think might be causing this problem?" 



Reprinted With Permission 
Copyright, Interact Perforinance Systems, Inc., 1982 
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MCOT 03 

your subordinates finishes a complicated inspection ahead of 
schedule making it possible for you to get under ahead of time. 



You approach the subordinate and state: 

1. ’’Finishing that inspection ahead of schedule really helped out. 
What can I do to help you beat schedules in the future?" 

2. "Finishing that inspection this morning made it so I could get under 
way ahead of time. Thanks." 

3. "I really appreciate your finishing that inspection ahead of 
schedule this morning. Thanks." 

4. "Because of your good attitude, we were able to get under way ahead 
of schedule. That was really important to the crew. Thanks." 

5. 'You're a real dependable person. Being able to depend on you takes 
a lot of pressure off me. Keep it up." 



(27) 



HCQ104 

D. You observe a subordinate using a shortcut to complete an important 
electrical test. After you explain that failure to follow the test 
procedures could produce inaccurate results, the employee says: 

'This shortcut won't make the test all that inaccurate, 
and besides, we've got such a backlog of these tests. 

This shortcut really helps me out." 

Knowing that the regular procedures are, in fact, appropriate and that 
you have to motivate the person to use them — you respond: 

1. 'You seem upset, is it because you feel the tests take too much 
time?" 

2. "Maybe these procedures are a bit too rigid. I'll check into it and 
let you know." 

3. "If the tests are any less accurate it could damage the equipment." (28) 

4. "Is there anything I can do to help you follow the correct 
procedures?" 

5. "I know the procedures seem picky, but I’d really appreciate it if 
you would follow them exactly." 
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E. You observe that the lookout on watch is absent-mindedly staring at the 
deck rather than alertly scanning the horizon. After e.tplaining that 
the way he or she is looking for ships is not active or alert enough, 
the lookout says: 

'Trying to keep a lookout here is just busy work. There 
are hardly ever any ships out here. Besides, the radar 
will shov,’ what's out there anyway." 

Knowing that keeping an active watch is important, you respond: 

1. "I appreciate that it's tough, but it's your job and I have 
confidence you can do it." 

2. "I can see yore really bored. Is there anything I can do to help 
you stay alert? 

3. ’T understand your concern, but trust me, keeping an alert watch is 
critical. " 

4. 'T know what you mean. Maybe we can manage with just the radar for 
a whi le." 

5. "If you don't keep an alert watch we could miss craft that radar 
doesn't pick up." 



MCQ1Q6 

F. A subordinate has just come to you with a work-related problem. The 
subordinate is VEKf ANGRY about the equipment he or she has to woik with 
and states: 



'This equipment is driving me nuts! 

It's way too slow!" 

You respond 

1. "What seems to be the exact problem?" 

2. "What's making you mad is that the equipment is slowing you down?" 

3. "Could you help me understand how this could affect our schedule?" 

4. "Is there anything I can do to help ycu solv^ the problem?" 

5. 'Do you think we can gather information in order to figure OJt why 
it is slewing so much?" 



(29) 



(30) 
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MCQ1Q7 

G. You notice an experienced subordinate involved in an unsafe work 
practice. You approach him or her and state: 

1. 'This is the third time this week I’ve noticed you standing inside 
the reconmended safe distance of this equipment.” 

2. 'You shouldn’t be doing that. Yoj could get hurt.’' 

3. "If that machine acts up it could break your wrist." (31) 

4. "I'd really hate to see you get hurt. Tty to be safer from now on." 

5. ’You're working in an unsafe manner Is there anything we can do so 
it won’t happen in the future?" 



MCQ1Q8 

H. You’ve just spoken to a subordinate about using an incorrect procedure. 

The suborinate becomes furious and states: 

"I’m not the only one who does the job this way! 

Why pick on me?" 

You respond: 

1. "Is there a way I can help you so you won’t have to use this 
incorrect procedure in the future? 

2. "Using this procedure could result in a loss of water tight 
integrity. ’’ 

3. "I know other people do the job this way too, but right now we're 

talking about you." (32) 

4. ’You seem upset. Do you think I’m picking on you?" 

5. "I can see you're pretty upset about this. Why don’t you take a 
break for a few minutes and then 've can talk about it." 
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I. One of the best subordinates in your engineering department has been 
working for several hours on a very complicated part in the air 
conditioning system and has made little headway. You approach the 
subordinate and he or she says: 

''Let’s see if I can explain what's going on here. The 
inner-flange on this part needs to be rounded to within 
one one-thousandth in order to set the bearing and seal 
combination. I've got part of it ground out, but the 
ledge where the seal goes isn't right and I need to figure 
out a way to make a diagonal cut so that I can get it to 
tolerance. " 

You respond: 

1. "Sounds to me like you've got a good start at solving the problem. 

If you keep at it, I have confidence that you’ll be able to solve 
it- ’’ 

2. "I'll get another engineer to help you. Meanwhile, you keep working 
at it so that we can complete this repair on schedule and meet our 
cocmitment by five tonight." 

3. 'This problem sounds pretty complicated, what do you think is 

causing it?" . (33) 

4. ’Tt sounds to me like you could use some help from the company that 
designed this." 

5. "Let’s see if I understand. • You’ve got part of the job done, but 
you are being slowed down because of troubles in grinding out the 
ledge." 



Answer the following questions by circling the number in front of 
the response that you think best deals with the situation. 

MCQllO 

J. In observing a problem with a subordinate, it is best to first : 

1. the subordinate what he or she is doing and why. 

2. Ask what you can do to help. 

3. Make the subordinate feel at ease by first striking up a friendly 

conversation. (34) 

4. Describe the nature of the problem in detail. 

5. Explain the consequences of what the subordinate is doing. 
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K. When working v/ith a subordinate in order to find out why a particular 

problem he or she faces exists, it is best to; 

1. Bring two or more subordinates together to involve them all in 
participative decision making. 

2. Outline what you think the source of the problem is and ask the 
subordinate what he or she thinks. 

3. Ask the subordinate if he or she would like you to bring in an (35) 
expert to help solve the problem. 

4. Ask the subordinate what he or she thinks the source of the problem 
is. 

5. Ask what you can do to help. 

MCQ112 

L. When a subordinate questions the reason why something has to be done a 

certain way (and you know the reason), it is best to: 

1. Explain the impact that doing it the required way has on the way the 
job comes out. 

2. Express your appreciation for the subordinates concern, but maintain 
your authority by assuring him or her that those who designed the 
method knew what they uere doing. 

3. Work with the subordinate in order to determine what can be done in (36) 
order to sinplify making it the required way. 

4. Ask the subordinate whether you can help him or her do the Job in 
the correct way. 

5. Express your appreciation for the subordinate’s concern and tell him 
or her that you will check into the matter in detail. 



MCQ113 

M. When a subordinate does an oitstanding job, it is best to first: 

1. Indicate that you are pleased with what be or she had done and that 
you hope he or she will be able to achieve similar results in the 
future. 

2. Describe in detail what the subordinate did, express your 
appreciation and describe what happend as a result of it. 

3. Put the subordinate at ease by starting with some friendly 

conversation. (37) 

4. Express your sincere appreciation for what the subordinate did, and 
explain what happened as a result. 

5. Express your appreciation, describing what happened as a result, and 
tell them you’re glad the^’’ have such a good attitude- 
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MCQ114 

N. In dealing with an angry subordinate, it is best to: 

1. Go right to problem-solving in order to avoid having the subordinate 
get more and more angry. 

2. Ask the subordinate to e.xplain what it is that is making him or her 
angry. 

3. Mention something the subordinate has done well to show that you 

value him or her. (38) 

4. Walt for the subordinate to calm down and then come hack and solve 
the problem later 

5. Maintain your control by using a firm tone of voice and explaining 
the problems that happen when a person loses his or her temper on 
the job. 



MCQ115 

0. When there are several possible ways to solve a problem that a 
subordinate faces, and you think that some of them would probably work 
better than others, it is best to first: 

1. ' Ask the subordinate for the solution that he or she thinks would 

work best. 

2. Write down the solutions that you think would work best, and discuss 
them with someone who has had experience with similar problems. 

3. Express your appreciation for the ideas and ask the subordinate to 

check them out with someone with more experience. (39) 

4. Act on the solution that you think is best and have the subordinate 
gather information about the problem to make sure that the solution 
works . 

5. Call over another subordinate in order to gain more participation in 
solving the problem. 
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At one time or another, supervisors ask their subordinates 
for their ideas. In the following questions we give four 
different reasons why a supervisor might ask subordinates 
for their ideas. Please read each of the four reasons and 
then place a ”1” by the reason that best represents why 
you ask subordinates for their ideas. Then place a '2" by 
the second best reason, and ”3" by the third best , and a 
"4” by the fourth best reason. 



It 


is best 


to a^ subordinates for their ideas because: 




MCQ116 A 


A. 


You can help subordinates learn important ^ills that they need 
by having them work through problems themselves. 


(40) 


MCQ116B 

MCQ116C 


B. 

C. 


Subordinates can help a super/isor out of a tough situation. 

Subordinates are more likely to try the solution if they have 
had a real part in the decision. 




MCQ116D 


D. 


Since subordinates are closest to the problem, they might 
provide information you were unaware of. 


(43) 



It is best to ask subordinates for their ideas because: 



117A' 



A. Supervisors can't be expected to know everything about each job, 
90 they need to rely on subordinates' ideas. 



117B- 



3. Since subordinates are closest to the problem, they probably 
have the best information. 



117C 


C. 


Cioing to all the trouble 
because subordinates may 


117D 


D. 


Subordinates should be 
learn and grow. 



to involve subordinates can be worth it 
work harder in the long run. 

involved simply because they need to 



It is best to ask subordinates for their ideas because: 



118A 


A. 


118B 


B. 


118C 


c. 


118D 


D. 



You can get subordinates to think of your solution as their 
"own" idea. 

Even though the ideas may be impractical or naive, it is 
important for subordinates to feel involved. 

You're more likely to identify the real problem if you use the 
subordinates' expertise. 

Supervisors are so involved in managing that they must rely on 

the subordinates to work through the problems. 



{51 
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E. SUPERVISOR EVALUATION OF TRAINING 



This questionnaire was given to supervisors who had 
been trained as part of the Problem Solving Skills for 
Managers Training Program. It was designed to measure 
the supervisors' reaction to the training program and 
their motivation as determined by intrinsic and extrinsic 
factors . 
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INTERACT PERFORMANCE SYSTEMS 
SUPERVISORY EVALUATION OF TRAINING QUESTIONNAIRE 







TQ 



The purpose of this quesoi.onr.air- 
opinion of the Interact training 
completed. Your answers will be 
please feel free to say what you 



is to measure your 
program you have now 
kept confidential, so 
feel . 



Name : 



(6-9) 



Once again, only the researchers at Interact Performance 
Systems will have access to your survey. 



Reprinted With Permission 

Cooyncnt, Interact Performance Systems, Inc., 19S2 
All Rights Reservea 
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INSTRUCTIONS 



1 . 



Most questions can be 
given. If you oc not 
case, cnoose the one 



answered 
that is c 



by choosing one of 
exact answer that 
losest to it. 




answers 

your 



2 . 



Answer questions by circlinc the number of your answer choice, 
as shown in t.his e.xampie. 



0: To what extent are you satisfied 

with the car you drive? 



z 


o 


a 






X 


X 


Qi 


0 




<v 




c 


9 




c 



1 2 3 4 0 6 7 



(A response of ”5" would mean that you are satisfied 
with the car you drive somewhere between "some extent" 
and "great extent" but closer to "some extent."). 



3e sure each answer 



is clearly marked. 



PLEASE ANSWER 



E^/ERY QUESTION 
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SZTQ 



I. How well do the skills work? 

To what extent are the skills taught 
in tne program effective wnen you 
use them to: 

SETQIOIa. Began discussing a problem with 
a subordinate who is performing 
poorly on the job? 

SETQlOlB. Figure out why a subordinate is 
not performing well on the 30 D? 

SETQIOIC. Encourage a poorly performing sub- 
ordinate to want to work harder? 

SETQIOID* Involve a subordinate in finding 
a solution to a tougn problem 
on the 30 b? 

SETQIOI^* Get an angry subordinate to calm 
down? 

SETOlOl^* Help a suborniate see that you 

understand his or her description 
of a complex problem? 

SETQlOlG. Figure out long-term solutions 
that will keep problems from 
coming up in the future? 

SETQIOIH. Make sure your subordinate under- 
stands exactly what you expect 
him or her to do to solve a 
problem? 



c 

2 



2 3 



( 17 ) 



II. In summary, to what extent: 



SETQ102A- 

SETQ1023. 

SETQ102C. 



SETQ102D. 



Do you think the skills taught 
actually work? 

Do you disagree with a lot of 
what was taught in the program? 

Are the skills taught in the 
program too soft so that if you 
use them your subordinates will 
take advantage of you? 

Are the skills taught in the 
program too underhanded so 
that if you use them you feel 
you are taking advantage of your 
subordinates? 



1 

1 



2 

2 

2 



3 

3 

3 

3 



4 

4 

4 

4 



5 

5 

5 

5 



6 

6 

6 

6 



7 

7 

7 



(28) 
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Some exlui^l 



1 

I 



Ill , 



How worthwhile was the training? 



0) 



To what extent 
training : 



you think the 



SETQ103 A. 

SETQ103 3. 

SETQ103 C. 
SETQ103 D. 

SETQ103 2. 

SETQ103F. 

SETQ103G. 



Was worth the ti.Tie and effort 
spent on it? 

Was an unpleasant and unccn- 
fortable experience? 

Was something you en 3 oyed? 

Was largely a waste of time 
because you had similar 
training in the past? 

Was a waste of time because 
it was not related enough 
to the real supervisory 
problems you face? 

Made you more comfortable with 
the way you have to treat your 
suDordinates in order to get 
things done? 

Wasted valuable time that you 
would rather have spent 
elsewhere? 



Pace 4 



<D 

E 

0 

in 



1 2 3 4 5 6 

1 2 3 4 5 6 



5 6 



( 29 ) 



1 2 



1 2 3 4 5 6 7 

1 2 3 4 5 6 7 



IV. What kind of impact did the training 
have? ' 

To what extent do you think the 
training : 



SETQ104A. 

SETQIOAb. 

SETQ104C. 



Improved your skills in dealing 
with tough situations with your 
subordinates? 1 2 

Was something you were able to 

use on a daily basis? 1 2 

Was something you didn ' t really 
need because you were satisfied 
with your skills when the training 
started? 1 2 



SETQ104D. 
SETQ104E- 
SETQIO4E . 



Helped you do a better 30 b? 1 2 

Benefited your subordinates? 1 2 

Increased the amount of work your 
suDordinates do? 1 2 



3 

3 



3 

3 

3 

3 



4 5 6 7 

4 5 6 7 

4 5 6 7 

4 5 6 7 

4 5 6 7 

4 5 5 7 



(41) 
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V. How did the other people wno were trained 
in the same workshop group as you feel 
about: che program? 

To what extent: 



ETQ105A. 

ETQ105B. 

■ ETQ105C. 

ETQ1050- 

.ETQIOSe. 

;ETQ105^- 

;etqio5g. 

;etqio5h. 



Were others in your training 
group (s) cooperative? 

Were they ’’involved " in the training? 

Did they support your efforts to 
learn and practice the skills in 
class? 

Did others take the training 
serious ly ? 

Were others willing to try out the 
new behaviors? 

Did others seem to take the training 
as just a game? 

Did others seem to act as if they 
were only sitting through the train- 
ing because they were forced? 

Was there an individual or group 
who resisted the program and lowered 
the overall enthusiasm? 




1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 



iETQlOSI* Did others benefit from the program? 

IETQ105J- Did others actually change the v/ays 
they work with people? 



1 2 3 4 5 6 7 

1 2 3 4 5 6 7 



( 42 ) 



VI. How did other people in the organization 
feel about the program? 



;ETQ106a. 

5ETQ106B. 

1ETQ106C. 

5ETQ106D. 

5ETQ106E. 

3ETQ106F. 



Did the people above you in the chain 
of command support the program? 

Did other key supervisors support 
the program? 

Were your subordinates aware of 
the training program before it 
began? 

Were your subordinates generally 
supportive of the training program? 

Did your subordinates make fun of 
your attempts to use the skills? 

Did your subordinates support your 
efforts to use the skills with them? 



1 2 3 4 5 6 7 
1 2 3 4 5 6 7 

1 2 3 4 5 6 7 
1 2 3 4 5 6 7 
1 2 3 4 5 6 7 
1 2 3 4 5 6 7 



(57) 
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(4 1 eat extent 



^age o 



v:i , 



What were the reasons for 
the skills? 



rying 



To what extent did you try tne 
ski 11s: 



SETQ107 A. 

SETQ107B. 

SETQ107C. 

SETQ107°- 

SETQ107E. 



Because the trainers were senior 5 

to you and not because you thought 

that the skills might work? 123 

Because the skills made sense? 123 

Because the skills seemed to work? 123 

Because you felt comfortable 

using the skills? 123 

Because your supervisor supported 

using the skills? 123 



0 

OQ 

4 

4 

4 

4 

4 



(62) 



VIII. What was it like going through the 
training? 

SETQIOS^* Overall, how would you rate the number 
of training sessions? 

1. Too few. 

2. About the right number. 

3 . Too many . 



SETQ108B. Overall, how would you rate the pace of the 
training? 

1. Too slow. 

2. About right. 

3 . Too fast . 



SETQIOS^* Overall, how would you rate the complexity 
of the training? 

1 . Too s imple . 

2* About right. 

3. Too complex. 



(65) 
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Great exlerjt 



Pace 



IX. Kow much practice was done? 

While you were participatinc in training, 

iTQ109 A. 



on the averace : 



SETQ109D. 



How mucn time was sper.t 
Rehearsal Cards in each 


session? 


g th 








1 . 


Less than 5 minutes 


5 . 


31 


to 


40 


minutes 


2. 


5 to 1 0 minutes 


6 . 


41 


to 


50 


minutes 


3. 


11 to 20 minutes 


7. 


51 


to 


60 


minutes 


4. 


21 to 3 0 minutes 


8. 


61 


to 


70 


minutes 



9. More than 70 minutes 

SETQ109B. How many Rehearsal Card situations did you oractice 



( 66 ) 



when 


USl 


ng 


the cards in 


each session 


•p — — 


1. 


0 


to 


1 


situation 


5 . 


8 


to 9 situations 


2 . 


2 


to 


3 


situations 


6 . 


10 


to 11 situations 


3. 




to 


5 


situations 


7. 


12 


to 13 situations 


4 . 


6 


to 


7 


situations 


S. 


14 


to 15 situations 












9. 


More than 15 situations 



(67) 



SETQ109C. How many times a week d-d you practice using the skills 



by 


fulfilling a fixed contrac 


t t 


0 practice? 


1 , 


None 


5 . 


Four 


2. 


One 


6 . 


Five 


3. 


Two 


7. 


Six 


4. 


Three 


8. 


Seven 






9 . 


Eight or more 


How 


many times during a week 


did 


you set aside > 


or 


place to look for chances 


to 


use the skills 


con 


tracts ) ? 






1. 


None 


5. 


Four 


2. 


One 


6 . 


Five 




Two 


7. 


Six 


4. 


Three 


8. 


Seven 






9 . 


Eight or more 



( 68 ) 



( 69 ) 
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SETQ109E. How many times between each session did your trainer talk 



to 


you about using 


the skills? 




1 . 


None 


5. 


Four 


2 . 


One 


6. 


Five 


3. 


Two 


7 ^ 


Six 


4 . 


Three 


8 . 


Seven 



Eicht or more 



( 70 ) 



X. How many times did you talk about the Interact training orogram 
outside of class each week? (Please write the number of times in 
the box to the right) 



SETQllOA. 


With 


other people going 


SETQ1103- 


With 


your instructor or 


SETQllOC- 


With 


your supervisor? 


SETQIIOd. 


With 


your peers? 


SETQIIOe. 


With 


vour suDordina tes ? 


SETQllOF. 


With 


your family? 


XI. Overall; 





SETQlllA, To what extent do you value the 
skills taught in the program? 

SETQlll®* what extent are you committed 

to using the techniques in the 
program? 

SETQlll^* To what extent did you become 
excited about using 
the skills in the program? 

SETQlll D. To what extent has this 

program interested you in 
more training of this 
type? 



lininng ? 


□ 


•uctors ? 


□ 




□ 




□ 




□ 




□ 








o 


jj 


X 

0) 


jJ 


0) 

E 


0 


5 




w 


12 3 


4 


12 3 


4 



( 71 ) 



( 76 ) 



c 

7 



:ard2 



(17) 



( 20 ) 
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In interviews people have ocid us that they often don't use the 
skills from training programs as often as they'd like. When 
asked why, rhey explain that, while they might want to use the 
skills, at times they "forget." They are sc used to their old 
ways of doing things, they don't stop to think about using t.he 
new skills. I.n this section we'd like to asK you some questions 
about this problem. 



XII . 



Please think of the times you have used skills from this 
program, and where you were when you thought to use the 
skills. We would like to k.now where people are and what 
they are doing when they "stop and think" of a chance to 
use these skills. w 

o 



How frequently have the following state- ^ 
ments been true for you: 

SETQ112 a. Duri.ng a trai.ning session 1 thought ; 
of an opportunity to use one of 
t.ne skills. : 

SETQ112 b. I had set aside a time to look 

for chances to use the skills, and 
during that time 1 saw (or thought 
of) a chance. : 

SETQ112 c. I was not specifically looking for 
a chance to use tne skills, but 
saw a problem in my work area and 
thought, "This is a chance to correct 
that problem I've never gotten 
around co solving." 

SETQ112 ^ didn't see the chance to use 

the skills at first, but found 
myself getting angry at someone 
and that reminded me to use the 
skills. ; 



o 

> 

o 

cn 



(2 J 



SETQ112 ^ halfway into a discussion 

and saw that what I had begun 
with wasn’t worki.ng and that 
reminded me to use the skills. 

SETQ112 f. I thought to use the skills be- 
cause the last time the discussion 
had blown up in my face and t had 
said to myself, "Next time I'll 
use the skills." 



1 2 



(26 



118 



Very frequently 



?age 10 



XIII. Whenever you try something new, you have to concentrate 

Ir's difficult and you have to pay close attention. 

SETQliiA With time, new activities become more familiar and you 
think about them less and less. For example, remember 
what It was like when you first learned to drive a car? 

It took a lot of thought at first, but with practice 
became routine. The same is true with new supervisory 
skills. The following list describes different stages in 
this cnange process. Please cneck the box (one only) tnat 
best describes your use of the new supervisory skills. 



a. I almost never use the new skills witnout 
"being aware of it" because they are still 
unfamiliar and take conscious effort. 

b. I occasionally use the new skills without 
"being aware of it" because they are 
becoming more familiar and take less 
conscious effort. 





c. I frequently use the new skills without 
"being aware of it" because tney are 
becoming more familiar and take less 
conscious effort. 



(27) 




d. I nearly always use the skills without 
"being aware of it" because they are 
quite familiar and take little conscious 
effort. 



03 

XIV. How frequently do you use skills from ^ 
the training program. . . o 




SETQ114a. At home with your family? 



1 2 3 4 5 6 7 



(28) 



SETQ114b. At work with your subordi nates ? 
SETQ114C. At work with other supervisors? 



SETQ114d. At work with vour immediate 
supervisor? 

SETQ114®* volunteer settings (at 

church, clubs, etc.) 



1 2 3 4 5 6 7 



1 2 3 4 5 6 



(32) 
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XV. Kow 
diff 

SETQllSa- 

SETQllSb- 

SETQ115=- 

SETQllS'^- 

SETQ115e. 



frequenrly do you use 
erent skills in the procrarr.? 

Communicating the situation? 
Using positive reinforcement? 
Solving motivation problems? 
Solving ability problems? 
Solving emergent problems? 




XVI. Please rank order the usefulness of the different skills in 
the program. Place a "1" by the skill you find most useful, 
a "2” by the second most useful, a "3" by the third mo sc 
useful / a "4** by the fourth mo^t useful , and a " 5 ” by the 
fifth most useful. 



SETQ116 

SETQ116 
SETQ116 c. 

SETQ116 d. 

SETQ116 e. 



Communicating the situation. 
Using positive reinforcement 
Solving motivation problems. 
Solving ability problems. 
Solving emergent problems. 



(38) 



(42) 



XVII, Please rank order the training sessions by how interesting 

they were for you. Place a "1” by the most interesting session, 
a "2" by the second most interesting, a ”3” by the third most 
interesting and a "4” by the fourth most interesting. 



SETQ117a. 


The 

the 


session covering 
situation and pos 


communicating 
itive reinforcement. 


SETQll^- 


The 


session 


covering 


motivation problems. 


SETQ117=- 


The 


session 


covering 


ability proolems. 


SETQllTi- 


The 


session 


covering 


emergent problems. 


XVIII. If 


you ' 


were in 


charge of 


the training and interested 



getting people to see all the opportunities to use the skills, 
what would you do? 



(43) 



(46) 
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APPENDIX B 



SUBQ PART III EACTOR ANALYSIS DOCUMENTATION 



A. EIGENVALUES, MEANS AND STANDARD DEVIATIONS 



Variable 


Esc. Communalicv 


Factor 


Eigenvalue 


Pet. of Var. 


Cua. Pec. 


Mean 


Standard Dev. 


Cases 


SUBQ109A 


0.87390 


1 


22.73058 


46.4 


46.4 


4.4783 


1 . 5653 


92 


SUBQ 10 9£ 


0.3793b 


2 


^.32835 


S.8 


55.2 


4.4674 


1.0538 


92 


SUBQ109C 


0.92476 


3 


2.07609 


4.2 


59.5 


4.2500 


1.523b 


92 


SUBQ109D 


0.83104 


4 


1.59553 


3.3 


62.7 


4.2500 


1.7265 


92 


SUBQ109E 


0.77579 


5 


1.50208 


3.1 


65.8 


3.5761 


1.7112 


92 


SUBQ109F 


0.83852 


6 


1.27250 


2.6 


68.4 


3.2717 


1.6515 


92 


SUBQ 10 9G 


0.84904 


7 


1.20079 


2.5 


70.8 


3.1196 


1.6893 


92 


SUBQ109H 


0.72915 


8 


1.13418 


2.3 


73.1 


3.3587 


1.7452 


92 


SUBQ 109 1 


0.65462 


9 


1.06750 


2.2 


75.3 


3.5543 


1.6796 


92 


SUBQ 109 J 


0.91061 


10 


0.97399 


2.0 


77.3 


4.6957 


1.5100 


92 


SUBQ109K 


0.83108 


11 


0.90176 


1.8 


79.2 


4.4457 


1.6533 


92 


SUBQ109L 


0.79931 


12 


0.84451 


1.7 


80.9 


3.4130 


1.7675 


92 


SUBQ109M 


0.87280 


13 


0.75969 


1.6 


82.4 


3.4674 


1.7331 


92 


SUBQ109N 


0.88295 


14 


0.73078 


1.5 


83.9 


4.2826 


1.6194 


92 


SUBQ 1090 


0.88980 


15 


0.66443 


1.4 


85.3 


4.2826 


1.6058 


92 


SUBQ109P 


0. 75559 


16 


0.64252 


1.3 


36.6 


3.2935 


1.3784 


92 


SUBQllOA 


0.79549 


17 


0.60701 


1.2 


87.8 


4.5000 


1.5724 


92 


SUBQllOB 


0.36575 


18 


0.56344 


1.1 


89.0 


4.5326 


1.5S60 


92 


SUBQlllA 


0.86496 


19 


0.48170 


1.0 


90.0 


2.7174 


1. 705-4 


92 


SUBQlllB 


0.87902 


20 


0.46129 


0.9 


90.9 


3.0435 


1.7969 


92 


3UBQ112A 


0.79141 


21 


0.^1574 


0.3 


91.7 


4.6304 


,1.7143 


92 


SUBQ112B 


0.88225 


22 


0.37495 


0.8 


92.5 


4.5870 


1.4336 


Q2 


SUBQ 11 2C 


0.86447 


23 


0.34653 


0.7 


93.2 


4 .4348 


1.^847 


Q2 


SUB0U2D 


0.39431 


24 


0.30049 


0.6 


93.8 


4.6087 


1.7094 


92 


SUBQ113A 


0.32433 


25 


0.27826 


0.6 


94.4 


3.3370 


1.0326 


92 


SUBQ113B 


0.89439 


26 


0.23647 


0.5 


‘ 94.9 


2.9891 


1.6206 


92 


SUBQ113C 


0.91828 


27 


0.22405 


0.5 


95.3 


2.8152 


1.3213 


92 


SUBQ 11 3D 


0.85808 


28 


0.21877 


0.4 


95.8 


2.7391 


1.6698 


92 


SUBQ114A 


0.86647 


29 


0.20707 


0.^ 


96.2 


4.5326 


1.4635 


92 


SUBQ114B 


0.87806 


30 


0.20133 


0.4 


96.6 


4.5870 


1.5839 


92 


SUBQ115A 


0.67595 


31 


0.17906 


0.4 


97.0 


4,0000 


1.6442 


92 


SUBQ115B 


0.84638 


32 


0.16851 


0.3 


97.3 


2.9348 


1.0495 


92 


SUBQ 1 15 C 


0.84551 


33 


0.15941 


0.3 


97.7 


2.9239 


1.3171 


92 


SUBQ 116a 


0.90407 


34 


0,13363 


0.3 


97.9 


4.6413 


1,5869 


92 


SUBQ116B 


0.88800 


35 


0.11928 


0.2 


98.2 


4.7391 


1.6366 


92 


SUBQ117A 


0.90372 


36 


0.11457 


0.2 


98.4 


4.4130 


1.6250 


92 


SUBQ117B 


0.88038 


37 


0.10726 


0.2 


98.6 


4,6304 


1.7079 


92 


SUBQ118A 


0,34664 


38 


0.09572 


0.2 


98.8 


3.3804 


1.5956 


92 


SUBQ118B 


0.82674 


39 


0.08528 


0.2 


99.0 


3.3370 


1 . 5^26 


92 


SUBQ118C 


0.89195 


40 


0.08234 


0.2 


99.2 


4.5543 


1.6197 


92 


SUBQ118D 


0.91688 


41 


0.06805 


0.1 


99.3 


4.9022 


1.6*446 


92 


SUBQ119A 


0.84129 


42 


0.06236 


0.1 


99.4 


3.4674 


1.6867 


92 


SUBQ119B 


0.87510 


43 


0.06002 


0.1 


99.5 


3.4130 


1.6250 


92 


SUBQ119C 


0.87212 


44 


0.04696 


0.1 


99.6 


4.2500 


1.7767 


92 


SUBQ119D 


0.39147 


45 


0.04262 


0.1 


99.7 


4.4783 


1.7571 


92 


SUBQ120A 


0.83710 


46 


0.04028 


0,1 


99.8 


3.5543 


1.3179 


92 


SUBQ120B 


0.81335 


47 


0.03589 


0.1 


99.9 


4.4348 


1.7117 


92 


SUBQ121A 


0.74166 


48 


0.02825 


0,1 


99.9 


2.7283 


1.7039 


92 


SUBQ121B 


0.34071 


49 


0.02776 


0.1 


100.0 
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CORRELATION MATRIX FOR VARIABLES 



^ 0 0''^0 'O ® •TOO 'O ■oo^~«njO**^'C ■•C -rn^- 

CJ nT « ' • 4 -tcj ui'>rr- •'*’ ■Of*' ■*.<(.'* "»0 

_• uO.'tf'^'T — ino^O fNl'TC' — «MT <D O <%lU' — *^ 0 ^“ 0 '<NJ»'< 0 •— f’'«NlO 13 T T ,r BO' n TO'T "O vU <Nj«r> 

O a 3 *-fvjr-ajffl,Ovr<r^<Njo<nncr<Nj<MO'' 0 (\(>o<Nj® O'OBO 

a f>»^ ^-OfNT (/'•'OiT* nir> n'f*'iTi O'O on ■T’O-onr'inu'T'T 



»/l OOOOOOOOO— OOOOOOOOOOOOOOOOO'JOOOOOOOOOOOOOOOOOOOOO 
I I I t I II I II I I I I III II II ill 



> TrMr>^-033n-<O'r>j'sjB-' .rinr- ■anr' 0 3"^r< o o r 

-> .r— •*~ ‘N— «n rt — a o -« 

— * WO' oT)<ononmf’'— <>j''jn'7'0''rij'u> OknonB-c'^oiT r*-u' o o oo'^c^ 

C 3 on *V^ J O'J^ OO *3 0 *“ o B — OBr>» O.-Njn.r T — on 7 ' 0 -*'«NB O "jn o v’' J'f** NT>-r( O 0 T" 

33 iN ^ n mtv ''TT'an'siTn-N'Nin > 4 'Mn njMmn nrn r rn'vj'>nnnnn'-g>4nnNj'4.*''»'_«.>4-\j'>j'^r 

13 

^ OOUOOOOO— J ooo a OOOOOOO 000 0:300000000 ooooooooooooooo 
till II I I I I till II I I I I II III 



y» •otsi;j* rNc^r'iuif'j— •^in ri<' 4 f\jrsi on'V .1 *-*'T «»-*vr' -r^-u ■sTH’ o 

0 u'*M~<*j«jrTviO'J' i' « •»»• r* o n«*» — tr a.r-'«» TikTi tjujr»'v»<x»vr .j-ojkon ■r»ir« u v» <ucj<i> 

— f«-^rkj<M>o— «rj 0 '*-' 0 'CC'^'T J'lrisT'?''**—— '““OTJ'TkoOO kr.m^r-C 7 ‘i*».otf' on COBT-C — 'M 

kj •vT'TCjnt'xk/'a'O'n'O'^kriv/’ — c^'mvr no-o ^• 3 *'B.o'n(a■B^T' 0 ^■TC•-- -o OT •—• oruo-'U^k/'Bn'O •TO' 

01 «— •— r>>«— >r«NjTOT — rkjn n — CJOJ«-*QJ«N<ViO OO* rslPi— — fVi — — — rM(k.<f»m — <MfMOCjn*“ T<NJ 

o 

0000000 — 0 OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOCOOO 
I I I I II I I I I till I till I I . I I I 



O' •— Nij BiJ'OnO'MnocnifkiiOirk — 'O'OOTX .a kf'BfVi'MfVir-'B B('~ <\jC'lT> O T B ontvn ■O'BBOfVi'Vj Cn 
3 Qrn— r>»n 03 o«M^ >orsi ® u> 00 «N O oniO — ^U^n^*•^-coa^<^l TmOfM— kTkfn nkTkfvifMa' <N)C Br-fvi^U' 
— 0 f'~O<N- 0 ir>o/i— O'OTOBn^.r TO'«NiT>'WBOr'B— tf'C'T<Nja 3 krkT'no'OB*i<'jOOO — — 

— 43 kTiOTvn— 'MOO'tP ^o'r-Nj’fMO'n— B— "’n — arr>-fMBr*'’r\ajo'tf'CJCjkr>'<j-o >u 

03 ,fsrTirnT'B'JTT'r»T' 0 <OTTnnnkrkTTT t«'t <it tt ■srTkTurkTnNrtrk^r tt .»rkr'f''.^io<»kvoT 



W 3 ocoooo— OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
till II till I I I I II I I I I II III 



(T> 0 'TlT 3 'TOn QujNrC'*n.on(r>vrfMO’*'nrvj 03 y'ir>BfM«Mn«— Okj,o<Mir»<Nj'\»on--U'B'*'OC^— nom— u' 

O n-uw'T— 0 ®'»n'wui*»nj^(*.Qr-n vjr>lk«kur»aju<n 'orni'jaj<^' 3 JO<NJ''kJ<VJT'JJT<Tkijuiu'(*>-k»kr~"Xt-of*'r'> 
— XCr<MT — —X .-x<M— ''•'T'lAB T» T — O OO'— ^n ^ TB O' -B B B O ffl (T «NjO T*^ O 'OO T -O -O n B 

O NT'NinrkjOOTk/'"’— T'MTinoBO'O'O'fMO^-'OOB a — n'r)f'“<N— iTkOnOT nnr*onrkj a 

jj ■*j»Mn Trsnr>T<''n<\jrkjrkjn«'mnn t mn <ttt T<\i.r<NjnrsinT <Tn^nn<T<vm^r 



vO OOOOO— OOOOOOOOOOOOOOOOOOOCJOOOOOOOOOOOOCJOOOOOOOOOO 
I I I I II till I I I I II I I I I II III 



O' 0*0 — TOT CJW-a O' f'* TOT f^ — kTk^-U'a *—<Mr»Ui >JrfO 0 ' 0 U'BBf"TB<M«''JI»*— B» 0 O^»^Jl^J — B 

o aonoo— — n<S 3 fnnu' — acncu otbcj o aT—— rkja.r^no^-*i’«'on— OPji/'ir>r*-o' 

— vTCJ^O — *OaaT kOI'^kOT TafNITf^mkO — • W TCJf<iNjV*''HBUHJ — ^ t 03 «iu *>X»k< ' — — 

C 7 Bno — OO'OnjIVjX/O.'*' B ('•r- <M-rk — . -•*U^— >Dr— •Ov 3 'r*-rk — rsiTT ’^'a— »nac 7 '<VJkf' 0 'Ta''*'NCJ — fNjC' a 

3 f'kji'jnnoaTT'TW'kjrkj'O’ n — »^nm'«<M^\jrNj«'jrk 4 r'Njr<*m<M(^rkj»Mrsji'.i— •«^J 1 '<^kJrkJ«^J 1 ■^JrkJn«^Jr^|rkJn o''M<mt 



k/i oooo— 0000 OOOOO 000 0000 ocoooooooooooooo 0000 OOOOOOOO 
I I I I II I I I I I I I I II I I I I II III 



I 

o 

T •NjaTOTO'O'— r--onr>»xkJO'— nnT<M OT® 00 *TfMi/v*»(>i— OBnO'O'— 0 '»/' 0 ' — — iMOOO'nk^m 

o TT a OOT'"''JT— iMOfNjnr — T»0 7 — nirk0''0 — '/''••BO'MB— 

^ '-tto'^'T- *'jo't— — aTTkTk— a^Niao— oo'^JcnB'MoofMTooa— Tk/'oiNn'Toinoirkn® 

-I «*r«.vro— ''i— nr- o"a OTin r*'B.r»a<Mn o Tnor— TTOr-T tO aOT^- T n— n cto«nt 

O kTi af'“On*'i'n— •rvj a a«M "^Tan ,f •r'<Njrsm,rtfvr'rn .-■''■''Ti/'rMn n rmi'- ar'.ini/'mrM'n ^ir'Tif'rnn 



000— 00000 0000 00000 000000 00 0000 0000 OOOOO 00 0000 00 00 

I I I I I II I II till III I I II III 



u 

T r— klkVjNT— T •<Jf\m» 0 *r\|^-r— <« « ujkXM'lkO •aTI’lf'kO'T fNilfkf’ir— •uCJTOr*' — — — akNifNlTr— kJJTT T ('~rVH'< 

o anoa"'' 0 '— n— (Tkf— — r-ui«j* jf— tt^'j'"— roucT— •r-"-o'o'— 0 <Ma 0 «' o 

-• kn^“CjTO''J— <M Okoa T kO<Ma a'r^o'ki'-nr-— TO»'-r«nrkxr'JO'<nm'-i'“'— <r — kn aT^-r-Q xm ^ 

U kor-cj Ton T v.;<*if’'' 4 j— no* — o* O'o — n<'jr> n/> uur— o<'<'Mi'*'MUjnajo* O^U— — ''*ujk/'< 4 1 '-O'o 

3 r— f— o<'”nnk/'nnr— r— TkfkaaTT'/'n.*^^if'a-on nn a a nnvr m T*>-a T t aTxTvrTU> a laTn 



k/l OO— OOOOO OOCJO 00 000 0000 000 OCOOOO 000 000000000 00 00 000 
I I I I I II I II till III II II III 



B 

ao'^ aOTaTu^arviOT— — «Br— OkTkanoT*^ tot atf'Tir>OTTni.— a*nkno'naTna 30 a»a 

O TOn.p B anrvja T OiTk aiTi— I"- X)B^» r — Bn-r TO^rvj ■ 3 rvj^» a'*'nkr>Orvi«NiO«r'Bkfk Oa — a^''*<n 
— BOf'^TT iia-u — 'Af'jnr'kj— rvj.— — — •>r aia; fM^- n a*'" Tr-r— a'" — Tknkiif'kjwP — rgrfi^. u ^< 7 * ^ 

o “'I'MTnna* a — rvjBTrvj ai'-«NnkT>— — — rkj— c o n B a Ba'TT a tf »o^ — ^ T a o o a 

3 -.nr— a»vinT — n oanT*— i^nuMaT r'aar— aniaTn laianT t ona a T kn»r>ianT -f Tka a ■* t 



T 0-0 300000 O 000 OO 0 O 0 O 0 C 0 OO 00 OO 00 O 00 O 0 C 0 C 0 3000000000 
I I I I I II ' > II till III II II III 



j* n.anf'jTT— T 'T'U'J‘<aT— 'n'*j>kj rivm' a T .rT --r— v/> — vj"MT O — ••'n T— — 
<a Okj*a V aPiw*/’— k* vj a'-o >r r*ik* >wu’ kow*<ji< ini'* 'mu' — uj-' nn >r<k — *r a— <'i(vi*ii^w*T — *j 

— * uiau'r-— wu'i-ka'xi— — nfManOH'.— ar-o— «'OT Tavr-cu'nr-kr>— aTO'aTacjJuni»'»a«Mc« T 
ri» nTiar-aTf^Taoaxo'VM'' — o — '^oonar-nnnar-— — kaia-rr— r 0 Tka'M»'* Tn«-« 
3 or^— -a ajn T-aif'- an -a on.p riaasanka-rn o'"n.r .faar*-an.raan'*'aiaT t«m -T 



<yy — vjaoook-rooi-ro v.i'-;v.»cjoO'-M-ik-/w WWW woosak-ioauiao 000000000000 000 

I I I I I II I II I I I I III II II III 



CQ 



<iaoOu 3 k*.v.;j. — .ii<tajkju«* ojkjo <iuJ^®o«»wu«jiw 

TO'TTTTTTO'O'O'TO'CT' TT O O — — aj«M«Njr\ian anT T'aia'a a af—r-BBXUJO'TC'TOCJ — — 
0000000000000030 — — — — — — -—-— — -————ryiNiNfM 

OOOOOOOOOOOOWOOOOOCJ'JOOOOOOOOOOO'JOrajOO OOO'OOO'JOOOOO 
BtBOBOBCBiOaiOBBaBBBBBBoaOBBcaBOBBBBBOffiO 3 xaBBBBBfflBCiaa 
00-30000000000000000000000000000000000000030000000 
a*a ka ka ka laT i/> k/i k /1 k/> k /1 »/>*/> k/i 1/3 k/i k /1 <a «/ 3 T k/ 1 1/1 k/ik/ik /1 (/I «/>«/ik/ik/!k/ik/ik/ 3 k/ii/>k/ik/ 3 k/i 1 / 1 1/1 «/>«/></> i/ 3 k/ 3 ka«/ik/i 
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cr->r rot'Mj'-<j,r — <>4— unrn-i'T'T 

•4 ^T>ajvn^r\j-*>r-4vfMT‘Or«Ovn'4-»-<-0r^'0t->'0vAU''^f^'Tf>-vAC*<N»<l'i7'f^'^O'<jr*»O<D^O'0Cr^®-“V/‘— 

O 'f (T^or^^- f*^o<7‘<v»>r <vnAO >or^<Nn^r^vrHf«-07‘'0>r vA>r>00<n-4 

a ■T'^ -T'^"Njn»^"<pnn^r\j<->>jaimfT> ^r«>oir^cjrn^ >r i/\>r ^vrs-ovT\ mm m >r m '» m/i - r i/' 



wn 0000000000 00«00000 0— Cii^OOOOOOOOOOOOOOOOOOOOOOOOCOO 
I I I I II till till II I I I I II III 



-4 m .*% 0 >r T3 r TSO'vj^ls'^'O'fC r-*omt? r-ry-4 — >40' -• -0 > OfAm n ->« .r 

m ?>»'«■ OO'—'^ “> '4^^ O' 7* TO -)r»-4Q ri,r*ncM'*m.O0' 3'0''“ -'mA'O'Aa-* — -O 0 — ''>4'>-4 raOA 

m mmvfi'vj'Au''rg<*3'3^^ o o>o>T'^0— ''“’Avn'vj-a^ ^'-^'^<T‘'r■'C^''>r-^•o^'^'Cv/^ 

-J 3 »f*. 7» j* 7»<N n J nvn aO'NOVAO^^ 3 Mf«._^a >a os > 4 -a 7 * ''•■Am a -o 

a or-n<'j'>jmvA>4'On-o ava^ -r-'' •AAo''~'rr-rTAA'-o*vo ro ava >jm.nvA r r 

3 

•41 00 oooo 3000 o 00 00000 — -»oo JO 0000 0000000000000 00000000 

till II till till II till II III 



OJ 

O 44 — iA«'— fvinnAUai'T •r'4JVJ'4JVJ' 4 <\)Cur- •« — «oi'J uj I'J u "O J IN, w J- u < u m O' 

— majrg5L«>0 0<J'r''-OOwjiM'Tj'.Jj -ruj j — 4'(Ni— u* ^au'r-.'T -xjfyjKj^ •oi'''Nj»r(*''*J-uf'-cj>j' u* or'—o''j4j4j 

— m— ''“'C^vA®7<7‘ ooajo-oOvAvf<ra''“vr>svAA4-ooo-^— ^<7*— >ci'’0-^''>Aj0i*^cr crviNvA'Mm — 

O — (A— O' •r>r— •r •rcr— m-<jmr>io A>r,C'Ai/'<r'AvA«.o'OvA''’ii;— •NjomvoS'f •taj'T >ro*(j' 



lA 000000 000 00 00 00 00— 0000000*0000 00 COO 0000 000 00 000 000 

I I I I I II I II till III II II I II 



O /\jr»i"mvA<\j ■oiAr'*'rO O* ajOs a.ova a: -t— ® — >4*— >x ^ iN.T'A-ojrsjc— -o>r Ova oCO^aimo® mmcu 

— or^mom <nj— — vAO -r — f- — 00®’^ “^vA-OOvAr^-A^ U'm Sf'»— m •cr-oi'" — miAoi — — o 

— o— •«r — 'NmO'Tirsf'-os^'A.^c r r ccr a^o— • r ov/‘'^fA— a''->r Asmo-roiM— >r xa ooj— m 

C/ aAif-'j-.mi? I'- m a; I'- f- CCA- a on Aj^A'XC'U'mcT-.ou'Aju'WNmo-o.j.oA. A«mf'-^<\)0 ' injc*.— am<NimvA 
oj A A >r 'T m(Nii«i— «si>n Am>r »r a isicr— m mmm a a A»m ^mm a <Nm 



A 000 000 ooooooooo 0—0 0000000 00*000 00000 00 00 000 00000 CO 

I I I I I II I II I I I I III II II III 



Q. 

O' -nojro — — ^— '—AAOJ >om^ An AJlAOSniNI A-4J'«r O'AI'-''- — mo — 0 A*^ — act- a — a AnjOIA A'A 
O ■*JP'-44 —<"«(>•» Cl'“l'4f»'<Mf'- U (A <NJCJO 'T aim A 4'<JCf'-ijr''''“mmr*»o* AlAr- A C'-'Ul’iOf'” A A'J* 

— m— AAAA'TAn^ AO— An O-C Am— '^<T>»y AsT C''- ——A A® — om O A — —mm ''•-^r -- a a — — a 

0 — -r T3 A<MSn An7‘”'0'0 0— OAS(M<M<Njmx3'A — A— '*'mrsjOAj’'7‘— nOOO'fCO'nAO' 

tfl mm ^ mnirg r*»rMm mm iNivr 'Mmcoj'M A Amm mr'i ^ a a A'm'nj ..r •r ^nimm^mminm — m.r <Nir»m 



A OOOOOOCJOOOCOOOO— 00 oooooooooooo 0000 000 000000000 000 
till II I I I I till II I I I I II III 



A — — oiwf—i/'A— AsiMOOSuA- o AAVAf-- Auj'MAi'-'- Am — r-^r A— >r‘D'0>r >r 

o vT- Aojaiooc'-roon— 'no eao— ' m'vj A'>J''if3Aooo >rm An AW'Ai/'f^ o — <m A*M<N4A>r nn 

— A 04 A ■«r «^A A A*Mr>gaj(NJ AfNiO Arnc'J a Ay'>X — AA AiJJ'A A »* >a <im\4 -vT *•-» — A AO i r- A'M .,r « ' 'X An 

O ma A'>i''“ J-rn'O-T'^ A AnO — ® A A -J AS AX — «r <7 ,*• — m og A sm -3 n 'M' o — -A A — m o 

O AAA A— m A Ol.,r "-0 o*A a o»a A A A< M •T sT >r A'" mmmf..A AAmA"- A*'’'^ AA^r A<XO» 



A 000 CO ooooooooo— 0000000000000000000000000000000000 

I I I I I II I II I I I I III I I II tit 



O' n— AOnmONjAmAM— cnno — -mr-AA— A'f^n OncrOAvrmmA<Nim^mxmcr*~mmmf'-(/‘ 
O OAA»'“m*—AOm('JA7' AOnnr- -no r O — '"n — A — O 3 — Om — r» -T — O Xi'i N*<M 0— nm^ A — m 
— rg— rvj .*r 'f’nQ ^rvj-^m — ^ OiNJ A^ A O A^ — 7 *mf— AXr— A-T A on «Ni'M fmAn — m^f’O' 

o '\j<Mn 04 ''“A' 7 «— nAmonanAn C O AOn^OlM'D'M O O <3 m— -A AO’"*’' Am — '—O"- A T 
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